Jun 11 19:23:44.520968 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 19:23:44.520982 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 19:23:44.520992 ip-10-0-130-228 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 19:23:44.521312 ip-10-0-130-228 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 19:23:54.522603 ip-10-0-130-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 19:23:54.522621 ip-10-0-130-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3718b3d01ded449092e905596827a8e1 -- Jun 11 19:26:21.831222 ip-10-0-130-228 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:26:22.210364 ip-10-0-130-228 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:26:22.210364 ip-10-0-130-228 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:26:22.210364 ip-10-0-130-228 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:26:22.210364 ip-10-0-130-228 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:26:22.210364 ip-10-0-130-228 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:26:22.211975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.211884 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:26:22.215379 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215362 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.215379 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215378 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215382 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215386 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215389 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215391 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215394 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215397 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215399 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215401 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215404 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215410 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215413 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215416 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215418 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215421 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215423 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215426 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215428 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215431 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215433 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.215445 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215435 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215438 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215440 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215443 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215445 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215448 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215452 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215454 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215458 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215460 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215463 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215465 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215468 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215470 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215473 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215475 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215478 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215480 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215483 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.215949 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215486 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215488 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215490 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215493 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215495 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215498 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215500 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215503 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215505 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215508 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215510 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215515 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215519 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215522 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215526 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215529 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215532 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215536 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215539 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215541 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.216401 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215544 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215547 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215549 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215553 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215557 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215561 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215564 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215566 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215569 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215572 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215575 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215578 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215581 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215585 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215587 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215591 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215594 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215597 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215600 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.216936 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215602 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215605 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215608 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215611 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215614 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215617 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215620 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215622 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215626 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215628 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215631 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215633 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215636 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215639 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215641 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215644 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215646 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215649 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215651 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.215654 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.217395 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216412 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216419 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216422 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216426 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216428 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216431 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216434 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216437 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216439 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216442 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216445 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216449 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216452 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216457 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216459 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216462 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216465 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216468 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.217891 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216470 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216473 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216476 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216479 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216482 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216484 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216487 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216489 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216492 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216495 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216497 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216500 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216502 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216505 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216507 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216509 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216513 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216515 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216518 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216520 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.218364 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216523 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216525 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216528 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216531 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216533 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216535 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216538 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216540 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216543 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216546 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216548 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216551 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216553 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216556 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216559 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216561 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216564 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216566 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216570 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.218853 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216574 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216577 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216580 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216582 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216585 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216587 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216590 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216592 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216596 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216599 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216601 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216604 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216606 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216609 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216612 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216614 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216617 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216620 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216622 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216624 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.219331 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216627 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216629 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216633 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216637 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216640 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216643 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216646 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216649 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216651 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216653 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216656 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216658 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216661 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216663 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216665 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216668 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216670 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216673 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216675 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.219924 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216678 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.216680 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217146 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217153 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217156 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217159 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217163 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217165 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217169 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217171 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217174 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217177 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217179 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217182 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217184 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217187 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217190 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217193 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217196 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217198 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.220384 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217201 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217203 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217206 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217208 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217211 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217214 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217217 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217221 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217224 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217227 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217229 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217232 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217234 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217237 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217239 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217242 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217245 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217247 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217250 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217253 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.220878 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217255 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217258 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217260 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217263 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217265 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217268 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217270 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217273 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217276 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217278 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217281 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217284 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217286 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217288 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217291 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217294 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217296 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217299 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217301 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.221411 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217303 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217306 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217308 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217311 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217313 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217316 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217318 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217323 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217329 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217332 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217334 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217337 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217341 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217345 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217348 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217351 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217353 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217355 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217358 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.221892 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217361 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217364 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217366 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217370 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217372 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217375 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217377 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217379 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217382 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217384 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217387 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217389 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217392 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217394 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217397 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217399 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217402 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217405 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217407 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217410 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.222366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217412 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217416 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.217422 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217496 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217508 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217514 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217518 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217524 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217527 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217532 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217536 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217540 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217543 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217546 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217549 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217553 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217556 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217559 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217562 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217565 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217568 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217581 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217585 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:26:22.222846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217588 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217591 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217595 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217599 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217602 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217605 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217608 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217611 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217614 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217617 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217621 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217625 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217630 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217633 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217636 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217639 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217642 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217645 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217649 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217652 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217655 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217658 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217661 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217664 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:26:22.223428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217667 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217670 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217673 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217676 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217679 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217681 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217684 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217687 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217689 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217692 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217696 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217699 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217702 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217705 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217708 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217711 2581 flags.go:64] FLAG: --help="false" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217714 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217717 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217721 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217726 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217729 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217732 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217735 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:26:22.224191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217738 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217740 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217743 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217747 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217750 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217753 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217756 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217759 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217762 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217764 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217767 2581 flags.go:64] FLAG: --lock-file="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217770 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217772 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217775 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217781 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217783 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217786 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217789 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217792 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217795 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217798 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217801 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217805 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217808 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217811 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 19:26:22.225208 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217814 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217817 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217821 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217826 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217829 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217831 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217834 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217842 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217845 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217848 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217851 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217854 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217860 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217863 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217880 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217883 2581 flags.go:64] FLAG: --port="10250" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217886 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217889 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f998b0b04547a7be" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217892 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217895 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217898 2581 flags.go:64] FLAG: --register-node="true" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217901 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217905 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217908 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:26:22.226400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217910 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217913 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217917 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217920 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217923 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217926 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217929 2581 flags.go:64] FLAG: --runonce="false" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217932 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217934 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217937 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217945 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217948 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217951 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217954 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217958 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217961 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217963 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217966 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217969 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217972 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217975 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217978 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217983 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217986 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217988 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:26:22.227435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217992 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217995 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.217998 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218000 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218003 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218006 2581 flags.go:64] FLAG: --v="2" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218010 2581 flags.go:64] FLAG: --version="false" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218014 2581 flags.go:64] FLAG: --vmodule="" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218018 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218021 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218132 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218136 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218138 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218141 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218144 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218146 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218149 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218153 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218155 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218158 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218160 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218163 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.228496 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218165 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218168 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218170 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218172 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218175 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218177 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218180 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218182 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218185 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218187 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218190 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218192 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218195 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218197 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218200 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218202 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218204 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218207 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218209 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218212 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.229280 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218216 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218219 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218222 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218225 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218228 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218231 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218233 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218237 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218240 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218243 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218245 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218248 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218250 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218253 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218255 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218258 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218260 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218263 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218265 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.230031 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218268 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218270 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218273 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218275 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218278 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218280 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218283 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218285 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218287 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218291 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218295 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218298 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218301 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218303 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218306 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218308 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218310 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218313 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218316 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218318 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.230518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218322 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218324 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218327 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218329 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218332 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218334 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218336 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218339 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218341 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218344 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218346 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218350 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218353 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218356 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218358 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218361 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218364 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218366 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218369 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.231036 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218372 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218374 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218377 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218379 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218382 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218384 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218387 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218389 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.218391 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.218396 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.226614 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.226642 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.226674 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.226693 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:26:22.231500 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226794 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226806 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226813 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226819 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226824 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226828 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226833 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226839 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226843 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226847 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226851 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226855 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226860 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226882 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226887 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226892 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226896 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226900 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226904 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226907 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.231859 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226912 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226916 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226920 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226924 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226928 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226932 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226936 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226940 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226944 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226958 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226963 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226967 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226972 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226976 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226980 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226984 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226988 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226993 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.226997 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227001 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.232441 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227005 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227009 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227013 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227018 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227022 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227026 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227030 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227035 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227038 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227043 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227047 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227051 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227056 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227060 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227064 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227068 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227073 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227077 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227080 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227085 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.232941 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227089 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227096 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227108 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227113 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227117 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227120 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227125 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227129 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227133 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227137 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227142 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227146 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227150 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227155 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227158 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227162 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227166 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227170 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227174 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.233580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227179 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227183 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227187 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227191 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227195 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227199 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227204 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227208 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227212 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227216 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227220 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227225 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227229 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227234 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227238 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227242 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227257 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227261 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227265 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.234340 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227270 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.227278 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227560 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227570 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227576 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227580 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227585 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227590 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227594 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227599 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227603 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227608 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227613 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227617 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227622 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:26:22.234804 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227626 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227631 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227635 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227639 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227644 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227648 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227652 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227656 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227663 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227670 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227674 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227678 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227682 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227687 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227691 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227704 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227709 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227713 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227717 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227721 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:26:22.235356 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227725 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227729 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227733 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227737 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227742 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227746 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227750 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227754 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227758 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227762 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227766 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227770 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227774 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227778 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227783 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227787 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227791 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227796 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227800 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227804 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:26:22.236193 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227808 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227812 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227816 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227820 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227824 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227828 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227835 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227840 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227853 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227859 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227882 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227887 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227892 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227896 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227900 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227905 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227909 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227913 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227916 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:26:22.236687 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227920 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227924 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227930 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227935 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227940 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227944 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227948 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227952 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227957 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227962 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227966 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227971 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227984 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227988 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227992 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.227997 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228001 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228005 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:26:22.237398 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228009 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228014 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228018 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228022 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228035 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228040 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228044 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228048 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:22.228052 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.228061 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.229742 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.231770 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.233111 2581 server.go:1019] "Starting client certificate rotation" Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.233238 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:26:22.237956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.233292 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:26:22.238315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.235715 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:26:22.238315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.236960 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:26:22.251905 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.251886 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:26:22.256324 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.256304 2581 log.go:25] "Validated CRI v1 image API" Jun 11 19:26:22.257155 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.257136 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:26:22.259554 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.259535 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b5c2ba6b-c79f-49bf-b48f-cca8b35b3cac:/dev/nvme0n1p3 baaeea0f-21bb-4092-be89-809b78022b4b:/dev/nvme0n1p4] Jun 11 19:26:22.259609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.259554 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:26:22.265973 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.265841 2581 manager.go:216] Machine: {Timestamp:2026-06-11 19:26:22.264463832 +0000 UTC m=+0.316248884 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094318 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244d2ca83e2cf35bb8fc06ed55e937 SystemUUID:ec244d2c-a83e-2cf3-5bb8-fc06ed55e937 BootID:3718b3d0-1ded-4490-92e9-05596827a8e1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:f7:ec:eb:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:f7:ec:eb:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:7b:4c:4a:3b:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:26:22.265973 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.265971 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:26:22.266083 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.266066 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:26:22.269102 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.269086 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:26:22.269906 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.269842 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:26:22.270072 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.269918 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:26:22.270550 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.270540 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:26:22.270582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.270553 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:26:22.270582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.270561 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:26:22.271177 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.271165 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:26:22.272499 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.272488 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:26:22.275076 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275064 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:26:22.275236 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275226 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:26:22.275280 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275272 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:26:22.275311 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275288 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:26:22.275311 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275302 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:26:22.275368 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275312 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:26:22.275368 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.275321 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:26:22.276276 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.276260 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:26:22.276322 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.276291 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:26:22.280473 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.280392 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:26:22.283103 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283083 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:26:22.283216 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283115 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:26:22.283660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283645 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:26:22.283660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283661 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:26:22.283765 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283667 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:26:22.283765 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283672 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:26:22.283765 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283680 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:26:22.283765 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283685 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:26:22.283977 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283968 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:26:22.283977 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283977 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:26:22.284031 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283984 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:26:22.284031 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283990 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:26:22.284031 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.283998 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:26:22.284031 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.284007 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:26:22.285256 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.285246 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:26:22.285256 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.285255 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:26:22.289042 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.289026 2581 server.go:1268] "Started kubelet" Jun 11 19:26:22.289174 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.289106 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:26:22.289242 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.289129 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:26:22.289242 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.289215 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:26:22.289811 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.289662 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:26:22.289811 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.289663 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:26:22.289811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.289748 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:26:22.290188 ip-10-0-130-228 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:26:22.290834 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.290707 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:26:22.291384 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.291371 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:26:22.295271 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.295250 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:26:22.295394 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.295283 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:26:22.295553 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.295529 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.296024 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.295990 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:26:22.296024 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296011 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:26:22.296170 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.295063 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-228.ec2.internal.18b81d675622e068 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-228.ec2.internal,UID:ip-10-0-130-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-228.ec2.internal,},FirstTimestamp:2026-06-11 19:26:22.288994408 +0000 UTC m=+0.340779460,LastTimestamp:2026-06-11 19:26:22.288994408 +0000 UTC m=+0.340779460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-228.ec2.internal,}" Jun 11 19:26:22.296258 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296242 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:26:22.296303 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296257 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:26:22.296433 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296417 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:26:22.296512 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296495 2581 factory.go:55] Registering systemd factory Jun 11 19:26:22.296561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296523 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:26:22.296617 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.296597 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:26:22.296812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296793 2581 factory.go:153] Registering CRI-O factory Jun 11 19:26:22.296812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296815 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 19:26:22.296996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296911 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:26:22.296996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296939 2581 factory.go:103] Registering Raw factory Jun 11 19:26:22.296996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.296958 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 19:26:22.297701 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.297674 2581 manager.go:349] Starting recovery of all containers Jun 11 19:26:22.298375 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.298354 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b778j" Jun 11 19:26:22.303272 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.303241 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:26:22.303368 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.303348 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:26:22.306496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.306347 2581 manager.go:354] Recovery completed Jun 11 19:26:22.307123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.307091 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b778j" Jun 11 19:26:22.313124 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.313104 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.315190 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315166 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.315305 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315204 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.315305 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315215 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.315777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315761 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:26:22.315777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315776 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:26:22.315929 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315783 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.315929 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.315795 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:26:22.316721 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316705 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.316832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316732 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.316832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316744 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.316934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316841 2581 policy_none.go:49] "None policy: Start" Jun 11 19:26:22.316934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316855 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:26:22.316934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.316888 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:26:22.317742 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.317648 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-228.ec2.internal.18b81d6757b2917c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-228.ec2.internal,UID:ip-10-0-130-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-228.ec2.internal,},FirstTimestamp:2026-06-11 19:26:22.315188604 +0000 UTC m=+0.366973659,LastTimestamp:2026-06-11 19:26:22.315188604 +0000 UTC m=+0.366973659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-228.ec2.internal,}" Jun 11 19:26:22.317985 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.317973 2581 policy_none.go:47] "Start" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.368780 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.368815 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.368825 2581 server.go:87] "Starting device plugin registration server" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.369168 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.369179 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.369288 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.369382 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.369389 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.370244 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.370297 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.371846 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.373132 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.373166 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.373186 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:26:22.374448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.373216 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:26:22.375760 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.375736 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:22.469675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.469558 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.470588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.470571 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.470687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.470605 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.470687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.470616 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.470687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.470639 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.473674 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.473649 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal"] Jun 11 19:26:22.473767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.473717 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.474621 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.474602 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.474720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.474629 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.474720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.474640 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.475943 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.475929 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.476053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.476094 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476072 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.476669 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476650 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.476780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476685 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.476780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476702 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.476780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476761 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.476949 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476788 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.476949 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.476803 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.478187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.478169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.478268 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.478205 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:26:22.478677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.478648 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.478748 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.478677 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-228.ec2.internal\": node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.478985 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.478968 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:26:22.479053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.479002 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:26:22.479053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.479017 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:26:22.494881 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.494835 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.497983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.497962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b616c8523a04a6fccd77daac93baa70-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"1b616c8523a04a6fccd77daac93baa70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.498077 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.497994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.498077 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.498020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.503757 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.503735 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-228.ec2.internal\" not found" node="ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.508331 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.508310 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-228.ec2.internal\" not found" node="ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.595923 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.595887 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.599151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.599203 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b616c8523a04a6fccd77daac93baa70-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"1b616c8523a04a6fccd77daac93baa70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.599203 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.599269 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.599301 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe61faafc04c23bbb65089376456371-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal\" (UID: \"efe61faafc04c23bbb65089376456371\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.599330 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.599271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b616c8523a04a6fccd77daac93baa70-config\") pod \"kube-apiserver-proxy-ip-10-0-130-228.ec2.internal\" (UID: \"1b616c8523a04a6fccd77daac93baa70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.696358 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.696309 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.797105 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.797028 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.806374 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.806346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.812487 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:22.812462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:22.898129 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.898089 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:22.998608 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:22.998575 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:23.099275 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.099184 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:23.199723 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.199689 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-228.ec2.internal\" not found" Jun 11 19:26:23.207441 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.207423 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:23.232188 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.232158 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:26:23.232707 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.232299 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:26:23.232707 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.232327 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:26:23.275454 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.275422 2581 apiserver.go:52] "Watching apiserver" Jun 11 19:26:23.296131 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.296107 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:26:23.296257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.296119 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" Jun 11 19:26:23.296950 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.296931 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:26:23.298611 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.298590 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-9t99q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl","openshift-cluster-node-tuning-operator/tuned-5xcc8","openshift-dns/node-resolver-dm92m","openshift-network-operator/iptables-alerter-mbghz","kube-system/global-pull-secret-syncer-9hplq","openshift-image-registry/node-ca-p872s","openshift-multus/multus-additional-cni-plugins-rlk5n","openshift-multus/multus-mwbbg","openshift-multus/network-metrics-daemon-7tbdd","openshift-network-diagnostics/network-check-target-tlv5h","openshift-ovn-kubernetes/ovnkube-node-ww7dt"] Jun 11 19:26:23.299955 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.299936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.301626 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.301606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.302827 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.302631 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:26:23.302827 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.302649 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ng878\"" Jun 11 19:26:23.302827 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.302637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:26:23.303695 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.303672 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:26:23.303816 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.303798 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.303937 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.303914 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rsl8b\"" Jun 11 19:26:23.304002 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.303979 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.304271 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.304251 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.304684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.304664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.305980 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.305791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.306325 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.306305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.306411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.306329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtmrb\"" Jun 11 19:26:23.307161 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.307144 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.307482 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.307460 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.307585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.307549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.308104 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.308086 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:26:23.308204 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.308167 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" Jun 11 19:26:23.308204 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.308193 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7ftpz\"" Jun 11 19:26:23.308494 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.308466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.308574 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.308544 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:23.309198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.309183 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.309312 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.309297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.309387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.309372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mvn89\"" Jun 11 19:26:23.309719 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.309704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.309797 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.309755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:26:23.310398 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.310380 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:26:23.311187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.311175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.311663 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.311647 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.311801 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.311787 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:26:23.311996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.311981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.312055 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.312030 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x7njh\"" Jun 11 19:26:23.312414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.312394 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:21:22 +0000 UTC" deadline="2027-12-27 11:26:34.151774327 +0000 UTC" Jun 11 19:26:23.312451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.312415 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13528h0m10.83936151s" Jun 11 19:26:23.312501 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.312489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.313441 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.313423 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.313600 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.313581 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:26:23.313694 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.313653 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rkz7g\"" Jun 11 19:26:23.313776 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.313751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.313839 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.313819 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:23.313944 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.313918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:26:23.314086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.314069 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:26:23.314151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.314075 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.314371 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.314354 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:26:23.314690 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.314672 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lv2sj\"" Jun 11 19:26:23.315250 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.315232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:23.315335 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.315305 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:23.316388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.316370 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:26:23.316609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.316487 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal"] Jun 11 19:26:23.316609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.316517 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal"] Jun 11 19:26:23.316609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.316578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.318713 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.318685 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:26:23.318947 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.318932 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:26:23.319090 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.318985 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:26:23.319090 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.319011 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:26:23.319224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.319210 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:26:23.319224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.319215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:26:23.319338 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.319265 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ff67b\"" Jun 11 19:26:23.328214 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.328191 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjqh4" Jun 11 19:26:23.334068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.334050 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjqh4" Jun 11 19:26:23.351695 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.351675 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:23.398062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.398031 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:26:23.403169 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cnibin\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.403313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-binary-copy\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.403313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-multus\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-conf-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-node-log\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.403313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-systemd\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-lib-modules\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-host\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-os-release\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-kubelet-config\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cni-binary-copy\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403568 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-hostroot\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-device-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-socket-dir-parent\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-kubelet\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c866068e-2897-479c-975c-420c5395c4f0-host-slash\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-os-release\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-k8s-cni-cncf-io\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.403833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-netns\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-etc-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt2vc\" (UniqueName: \"kubernetes.io/projected/15308ac6-f899-48b1-88dd-86de014005fe-kube-api-access-rt2vc\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-conf\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.403974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-var-lib-kubelet\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-multus-certs\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clvs\" (UniqueName: \"kubernetes.io/projected/61acf913-396c-41e9-9073-e13bb414c6fa-kube-api-access-6clvs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-env-overrides\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mfv7\" (UniqueName: \"kubernetes.io/projected/70ea44d8-8a55-4626-9719-26e3dabd4cd1-kube-api-access-9mfv7\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-ovn\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-kubernetes\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-run\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-socket-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-etc-kubernetes\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.404284 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-bin\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-config\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-system-cni-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-daemon-config\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-log-socket\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmkq\" (UniqueName: \"kubernetes.io/projected/57ce7edf-4c08-4045-ac74-657d10f3484e-kube-api-access-4vmkq\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-tuned\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-dbus\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-registration-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-sys-fs\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7l8v\" (UniqueName: \"kubernetes.io/projected/437b4f65-cc28-4006-a00e-d98543344c1c-kube-api-access-r7l8v\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-netd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-script-lib\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-agent-certs\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-modprobe-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzm6\" (UniqueName: \"kubernetes.io/projected/c866068e-2897-479c-975c-420c5395c4f0-kube-api-access-2wzm6\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.404982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cnibin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-bin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-systemd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-sys\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404824 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-tmp\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rph5m\" (UniqueName: \"kubernetes.io/projected/78a0bade-3c96-4a98-96f0-eb524364f82b-kube-api-access-rph5m\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrd8\" (UniqueName: \"kubernetes.io/projected/1b8c22b3-6421-4f25-9a9d-26978fd434e3-kube-api-access-8lrd8\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-system-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-netns\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.404996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15308ac6-f899-48b1-88dd-86de014005fe-host\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8c22b3-6421-4f25-9a9d-26978fd434e3-hosts-file\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8c22b3-6421-4f25-9a9d-26978fd434e3-tmp-dir\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-kubelet\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.405664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmsvj\" (UniqueName: \"kubernetes.io/projected/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-kube-api-access-zmsvj\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-systemd-units\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-slash\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405185 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-konnectivity-ca\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysconfig\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c866068e-2897-479c-975c-420c5395c4f0-iptables-alerter-script\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15308ac6-f899-48b1-88dd-86de014005fe-serviceca\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-var-lib-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.406220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.405362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ce7edf-4c08-4045-ac74-657d10f3484e-ovn-node-metrics-cert\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.424309 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.424268 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe61faafc04c23bbb65089376456371.slice/crio-11fe4b360ce914a4bad3ea3b21c75b9228f1ea6895e6df5bec55195fd085e378 WatchSource:0}: Error finding container 11fe4b360ce914a4bad3ea3b21c75b9228f1ea6895e6df5bec55195fd085e378: Status 404 returned error can't find the container with id 11fe4b360ce914a4bad3ea3b21c75b9228f1ea6895e6df5bec55195fd085e378 Jun 11 19:26:23.424548 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.424525 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b616c8523a04a6fccd77daac93baa70.slice/crio-46e004ed181e2ef0551832bd04b8e8a4798bd837b9a72195ae1b80ece940d1eb WatchSource:0}: Error finding container 46e004ed181e2ef0551832bd04b8e8a4798bd837b9a72195ae1b80ece940d1eb: Status 404 returned error can't find the container with id 46e004ed181e2ef0551832bd04b8e8a4798bd837b9a72195ae1b80ece940d1eb Jun 11 19:26:23.429361 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.429343 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:26:23.505573 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c866068e-2897-479c-975c-420c5395c4f0-iptables-alerter-script\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.505573 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15308ac6-f899-48b1-88dd-86de014005fe-serviceca\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-var-lib-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ce7edf-4c08-4045-ac74-657d10f3484e-ovn-node-metrics-cert\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505683 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-var-lib-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cnibin\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.505811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.505729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-binary-copy\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.506198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-multus\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-conf-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-node-log\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.506198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-systemd\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.506198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-lib-modules\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-host\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-os-release\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-kubelet-config\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-node-log\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.506427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-kubelet-config\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cni-binary-copy\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-hostroot\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15308ac6-f899-48b1-88dd-86de014005fe-serviceca\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-lib-modules\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-hostroot\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.506734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506627 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:26:23.507053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cnibin\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.507053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506911 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-os-release\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.507053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.506962 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-host\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.507187 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.507054 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:23.507187 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.507129 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.007107717 +0000 UTC m=+2.058892772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:23.507187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c866068e-2897-479c-975c-420c5395c4f0-iptables-alerter-script\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.507320 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.507226 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:23.507320 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.507287 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.007270963 +0000 UTC m=+2.059056001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:23.507411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-multus\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.507411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-conf-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.507411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-systemd\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.507804 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.507969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.507969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-device-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.507969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-socket-dir-parent\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.507969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-cni-binary-copy\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.507969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-kubelet\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.507977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c866068e-2897-479c-975c-420c5395c4f0-host-slash\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-os-release\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-device-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-k8s-cni-cncf-io\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-netns\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cni-binary-copy\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-socket-dir-parent\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-etc-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508101 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-etc-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt2vc\" (UniqueName: \"kubernetes.io/projected/15308ac6-f899-48b1-88dd-86de014005fe-kube-api-access-rt2vc\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-os-release\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.508291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-conf\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-var-lib-kubelet\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-kubelet\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c866068e-2897-479c-975c-420c5395c4f0-host-slash\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-k8s-cni-cncf-io\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-multus-certs\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-netns\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clvs\" (UniqueName: \"kubernetes.io/projected/61acf913-396c-41e9-9073-e13bb414c6fa-kube-api-access-6clvs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-env-overrides\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mfv7\" (UniqueName: \"kubernetes.io/projected/70ea44d8-8a55-4626-9719-26e3dabd4cd1-kube-api-access-9mfv7\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-ovn\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-kubernetes\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-run\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508608 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-multus-certs\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-socket-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.508975 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-etc-kubernetes\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-bin\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-config\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508741 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-ovn\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-system-cni-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-kubernetes\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508894 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.508903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-run\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509014 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-socket-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-openvswitch\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-etc-kubernetes\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-bin\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509131 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-env-overrides\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-daemon-config\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-log-socket\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmkq\" (UniqueName: \"kubernetes.io/projected/57ce7edf-4c08-4045-ac74-657d10f3484e-kube-api-access-4vmkq\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-tuned\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-dbus\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.509751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-registration-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-sys-fs\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7l8v\" (UniqueName: \"kubernetes.io/projected/437b4f65-cc28-4006-a00e-d98543344c1c-kube-api-access-r7l8v\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-netd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-script-lib\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-agent-certs\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-modprobe-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzm6\" (UniqueName: \"kubernetes.io/projected/c866068e-2897-479c-975c-420c5395c4f0-kube-api-access-2wzm6\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509622 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-daemon-config\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-system-cni-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.509884 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-modprobe-d\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-config\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-cni-netd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-log-socket\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.510599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510306 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cnibin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-bin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-systemd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-sys\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510513 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-cnibin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-tmp\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-cni-bin\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-registration-dir\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysctl-conf\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/437b4f65-cc28-4006-a00e-d98543344c1c-sys-fs\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57ce7edf-4c08-4045-ac74-657d10f3484e-ovnkube-script-lib\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-var-lib-kubelet\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.510919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74716a10-825f-4bd5-8d4a-59fcceccaa7a-dbus\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511058 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-run-systemd\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rph5m\" (UniqueName: \"kubernetes.io/projected/78a0bade-3c96-4a98-96f0-eb524364f82b-kube-api-access-rph5m\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrd8\" (UniqueName: \"kubernetes.io/projected/1b8c22b3-6421-4f25-9a9d-26978fd434e3-kube-api-access-8lrd8\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-system-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.511580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-sys\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-netns\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-run-netns\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-system-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15308ac6-f899-48b1-88dd-86de014005fe-host\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15308ac6-f899-48b1-88dd-86de014005fe-host\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8c22b3-6421-4f25-9a9d-26978fd434e3-hosts-file\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8c22b3-6421-4f25-9a9d-26978fd434e3-tmp-dir\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-kubelet\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmsvj\" (UniqueName: \"kubernetes.io/projected/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-kube-api-access-zmsvj\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-systemd-units\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-slash\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.511725 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.511749 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:23.512448 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.511763 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-konnectivity-ca\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysconfig\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:23.511824 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.011807157 +0000 UTC m=+2.063592216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-sysconfig\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8c22b3-6421-4f25-9a9d-26978fd434e3-tmp-dir\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.511986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-host-var-lib-kubelet\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-systemd-units\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-slash\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512090 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ea44d8-8a55-4626-9719-26e3dabd4cd1-multus-cni-dir\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512108 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8c22b3-6421-4f25-9a9d-26978fd434e3-hosts-file\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57ce7edf-4c08-4045-ac74-657d10f3484e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.513257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.512590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-konnectivity-ca\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.513585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.513400 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-tmp\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.513585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.513406 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a0bade-3c96-4a98-96f0-eb524364f82b-etc-tuned\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.513585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.513471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57ce7edf-4c08-4045-ac74-657d10f3484e-ovn-node-metrics-cert\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.513585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.513570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c828eda-3cbd-42a8-99f1-5527a6bff9b4-agent-certs\") pod \"konnectivity-agent-9t99q\" (UID: \"7c828eda-3cbd-42a8-99f1-5527a6bff9b4\") " pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.516280 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.516243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mfv7\" (UniqueName: \"kubernetes.io/projected/70ea44d8-8a55-4626-9719-26e3dabd4cd1-kube-api-access-9mfv7\") pod \"multus-mwbbg\" (UID: \"70ea44d8-8a55-4626-9719-26e3dabd4cd1\") " pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.516520 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.516500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clvs\" (UniqueName: \"kubernetes.io/projected/61acf913-396c-41e9-9073-e13bb414c6fa-kube-api-access-6clvs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:23.516640 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.516617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt2vc\" (UniqueName: \"kubernetes.io/projected/15308ac6-f899-48b1-88dd-86de014005fe-kube-api-access-rt2vc\") pod \"node-ca-p872s\" (UID: \"15308ac6-f899-48b1-88dd-86de014005fe\") " pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.517400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.517379 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzm6\" (UniqueName: \"kubernetes.io/projected/c866068e-2897-479c-975c-420c5395c4f0-kube-api-access-2wzm6\") pod \"iptables-alerter-mbghz\" (UID: \"c866068e-2897-479c-975c-420c5395c4f0\") " pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.517536 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.517520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7l8v\" (UniqueName: \"kubernetes.io/projected/437b4f65-cc28-4006-a00e-d98543344c1c-kube-api-access-r7l8v\") pod \"aws-ebs-csi-driver-node-lszwl\" (UID: \"437b4f65-cc28-4006-a00e-d98543344c1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.517938 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.517911 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmkq\" (UniqueName: \"kubernetes.io/projected/57ce7edf-4c08-4045-ac74-657d10f3484e-kube-api-access-4vmkq\") pod \"ovnkube-node-ww7dt\" (UID: \"57ce7edf-4c08-4045-ac74-657d10f3484e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.526108 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.526085 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rph5m\" (UniqueName: \"kubernetes.io/projected/78a0bade-3c96-4a98-96f0-eb524364f82b-kube-api-access-rph5m\") pod \"tuned-5xcc8\" (UID: \"78a0bade-3c96-4a98-96f0-eb524364f82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.526469 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.526452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmsvj\" (UniqueName: \"kubernetes.io/projected/9dd8d9eb-fd03-400a-94d8-5334fc3ef322-kube-api-access-zmsvj\") pod \"multus-additional-cni-plugins-rlk5n\" (UID: \"9dd8d9eb-fd03-400a-94d8-5334fc3ef322\") " pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.526784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.526768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrd8\" (UniqueName: \"kubernetes.io/projected/1b8c22b3-6421-4f25-9a9d-26978fd434e3-kube-api-access-8lrd8\") pod \"node-resolver-dm92m\" (UID: \"1b8c22b3-6421-4f25-9a9d-26978fd434e3\") " pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.528896 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.528880 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:23.633155 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.633061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:23.642065 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.642031 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c828eda_3cbd_42a8_99f1_5527a6bff9b4.slice/crio-14ee825eb44bc534a2c419af1c663f15fb989178a24dec4b4c38d55b8b751094 WatchSource:0}: Error finding container 14ee825eb44bc534a2c419af1c663f15fb989178a24dec4b4c38d55b8b751094: Status 404 returned error can't find the container with id 14ee825eb44bc534a2c419af1c663f15fb989178a24dec4b4c38d55b8b751094 Jun 11 19:26:23.650972 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.650947 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" Jun 11 19:26:23.654758 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.654737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" Jun 11 19:26:23.664580 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.664553 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a0bade_3c96_4a98_96f0_eb524364f82b.slice/crio-7b36094853323759e4e8869eaa311eac79bbe29f52b56a48fbbf0d87b06986ab WatchSource:0}: Error finding container 7b36094853323759e4e8869eaa311eac79bbe29f52b56a48fbbf0d87b06986ab: Status 404 returned error can't find the container with id 7b36094853323759e4e8869eaa311eac79bbe29f52b56a48fbbf0d87b06986ab Jun 11 19:26:23.671623 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.671601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm92m" Jun 11 19:26:23.680090 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.680062 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8c22b3_6421_4f25_9a9d_26978fd434e3.slice/crio-42890002a2f7bcf9b6de7681f6ba95274fbbaa7e955e68b2b424f51077862914 WatchSource:0}: Error finding container 42890002a2f7bcf9b6de7681f6ba95274fbbaa7e955e68b2b424f51077862914: Status 404 returned error can't find the container with id 42890002a2f7bcf9b6de7681f6ba95274fbbaa7e955e68b2b424f51077862914 Jun 11 19:26:23.687609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.687589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mbghz" Jun 11 19:26:23.695022 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.694993 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc866068e_2897_479c_975c_420c5395c4f0.slice/crio-c87af778ac876a991e595edf2e17e97efe25734f9b2c2b8c3d41009207620a05 WatchSource:0}: Error finding container c87af778ac876a991e595edf2e17e97efe25734f9b2c2b8c3d41009207620a05: Status 404 returned error can't find the container with id c87af778ac876a991e595edf2e17e97efe25734f9b2c2b8c3d41009207620a05 Jun 11 19:26:23.703460 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.703437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p872s" Jun 11 19:26:23.711103 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.711077 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15308ac6_f899_48b1_88dd_86de014005fe.slice/crio-d33ccda53adc17d7ed68210d70f783bb41f8f907eb72d9cf40b76014f00abea8 WatchSource:0}: Error finding container d33ccda53adc17d7ed68210d70f783bb41f8f907eb72d9cf40b76014f00abea8: Status 404 returned error can't find the container with id d33ccda53adc17d7ed68210d70f783bb41f8f907eb72d9cf40b76014f00abea8 Jun 11 19:26:23.714196 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.714174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" Jun 11 19:26:23.721578 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.721551 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd8d9eb_fd03_400a_94d8_5334fc3ef322.slice/crio-2add8cc2cb84bb7fdd11d18aa7d8655ec6fd012c3b893dad748f217bd298bd90 WatchSource:0}: Error finding container 2add8cc2cb84bb7fdd11d18aa7d8655ec6fd012c3b893dad748f217bd298bd90: Status 404 returned error can't find the container with id 2add8cc2cb84bb7fdd11d18aa7d8655ec6fd012c3b893dad748f217bd298bd90 Jun 11 19:26:23.725738 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.725720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mwbbg" Jun 11 19:26:23.730669 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:23.730648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:23.732940 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.732919 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ea44d8_8a55_4626_9719_26e3dabd4cd1.slice/crio-f071acc2f547cb202c509ef83af5136c416c557951968181a00774aaef327729 WatchSource:0}: Error finding container f071acc2f547cb202c509ef83af5136c416c557951968181a00774aaef327729: Status 404 returned error can't find the container with id f071acc2f547cb202c509ef83af5136c416c557951968181a00774aaef327729 Jun 11 19:26:23.738382 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:26:23.738356 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ce7edf_4c08_4045_ac74_657d10f3484e.slice/crio-22fc52c7e80b2c51377d0f1be8b9172b3e4d3dd81279f449b07dcf2946876771 WatchSource:0}: Error finding container 22fc52c7e80b2c51377d0f1be8b9172b3e4d3dd81279f449b07dcf2946876771: Status 404 returned error can't find the container with id 22fc52c7e80b2c51377d0f1be8b9172b3e4d3dd81279f449b07dcf2946876771 Jun 11 19:26:24.015750 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.015664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:24.015750 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.015719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.015750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015840 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015861 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015885 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015894 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015937 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:25.01592348 +0000 UTC m=+3.067708519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015952 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:25.015946148 +0000 UTC m=+3.067731187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:24.016000 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.015978 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:24.016456 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.016025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:25.016009109 +0000 UTC m=+3.067794151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:24.101277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.101044 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:24.336601 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.336427 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:21:23 +0000 UTC" deadline="2028-01-06 12:17:06.934538855 +0000 UTC" Jun 11 19:26:24.336601 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.336492 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13768h50m42.598051968s" Jun 11 19:26:24.375845 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.375352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:24.375845 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:24.375484 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:24.391668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.391586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" event={"ID":"1b616c8523a04a6fccd77daac93baa70","Type":"ContainerStarted","Data":"46e004ed181e2ef0551832bd04b8e8a4798bd837b9a72195ae1b80ece940d1eb"} Jun 11 19:26:24.397161 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.397074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"efe61faafc04c23bbb65089376456371","Type":"ContainerStarted","Data":"11fe4b360ce914a4bad3ea3b21c75b9228f1ea6895e6df5bec55195fd085e378"} Jun 11 19:26:24.416442 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.416318 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"22fc52c7e80b2c51377d0f1be8b9172b3e4d3dd81279f449b07dcf2946876771"} Jun 11 19:26:24.435083 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.435045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mwbbg" event={"ID":"70ea44d8-8a55-4626-9719-26e3dabd4cd1","Type":"ContainerStarted","Data":"f071acc2f547cb202c509ef83af5136c416c557951968181a00774aaef327729"} Jun 11 19:26:24.444959 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.444893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerStarted","Data":"2add8cc2cb84bb7fdd11d18aa7d8655ec6fd012c3b893dad748f217bd298bd90"} Jun 11 19:26:24.449961 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.448937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" event={"ID":"78a0bade-3c96-4a98-96f0-eb524364f82b","Type":"ContainerStarted","Data":"7b36094853323759e4e8869eaa311eac79bbe29f52b56a48fbbf0d87b06986ab"} Jun 11 19:26:24.455880 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.455818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t99q" event={"ID":"7c828eda-3cbd-42a8-99f1-5527a6bff9b4","Type":"ContainerStarted","Data":"14ee825eb44bc534a2c419af1c663f15fb989178a24dec4b4c38d55b8b751094"} Jun 11 19:26:24.470825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.470785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p872s" event={"ID":"15308ac6-f899-48b1-88dd-86de014005fe","Type":"ContainerStarted","Data":"d33ccda53adc17d7ed68210d70f783bb41f8f907eb72d9cf40b76014f00abea8"} Jun 11 19:26:24.486982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.486938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mbghz" event={"ID":"c866068e-2897-479c-975c-420c5395c4f0","Type":"ContainerStarted","Data":"c87af778ac876a991e595edf2e17e97efe25734f9b2c2b8c3d41009207620a05"} Jun 11 19:26:24.497606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.497566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm92m" event={"ID":"1b8c22b3-6421-4f25-9a9d-26978fd434e3","Type":"ContainerStarted","Data":"42890002a2f7bcf9b6de7681f6ba95274fbbaa7e955e68b2b424f51077862914"} Jun 11 19:26:24.499752 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:24.499716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" event={"ID":"437b4f65-cc28-4006-a00e-d98543344c1c","Type":"ContainerStarted","Data":"776d9ff6b8a29915c2e1e75e0c59e062988de1a100c9e9e19882a0b3fdb5e39b"} Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.023412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.023473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.023500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.023633 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.023694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:27.023677076 +0000 UTC m=+5.075462118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024199 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024219 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024231 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024282 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:27.024265454 +0000 UTC m=+5.076050501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024357 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:25.024429 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.024393 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:27.024382657 +0000 UTC m=+5.076167697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:25.135688 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.135655 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:26:25.337294 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.336652 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:21:23 +0000 UTC" deadline="2028-01-11 00:21:07.820632605 +0000 UTC" Jun 11 19:26:25.337294 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.336735 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13876h54m42.483902825s" Jun 11 19:26:25.374847 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.374122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:25.374847 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.374257 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:25.374847 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:25.374673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:25.374847 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:25.374783 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:26.376204 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:26.376174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:26.376654 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:26.376315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:27.045058 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:27.045013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:27.045321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:27.045072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:27.045321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:27.045095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:27.045321 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045249 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:27.045321 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045310 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:31.045292425 +0000 UTC m=+9.097077467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:27.045736 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045715 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:27.045818 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045743 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:27.045818 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045757 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:27.045818 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045801 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:31.045786547 +0000 UTC m=+9.097571592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:27.046009 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045858 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:27.046009 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.045913 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:31.045900589 +0000 UTC m=+9.097685630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:27.373464 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:27.373362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:27.373639 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.373495 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:27.373639 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:27.373582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:27.373830 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:27.373667 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:28.375075 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:28.375032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:28.375480 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:28.375163 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:29.374445 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:29.374406 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:29.374642 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:29.374549 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:29.374715 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:29.374668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:29.374886 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:29.374809 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:30.373493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:30.373461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:30.373923 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:30.373608 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:31.080816 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:31.080783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:31.081011 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:31.080833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:31.081011 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:31.080879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:31.081129 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081029 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:31.081129 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081095 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:39.08107547 +0000 UTC m=+17.132860523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:31.081541 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081518 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:31.081541 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081542 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:31.081707 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081559 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:31.081707 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081605 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:39.081590622 +0000 UTC m=+17.133375663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:31.081707 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081664 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:31.081707 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.081697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:39.081686519 +0000 UTC m=+17.133471561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:31.374824 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:31.374223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:31.374824 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.374374 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:31.374824 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:31.374410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:31.374824 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:31.374539 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:32.373967 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:32.373931 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:32.374081 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:32.374031 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:33.373572 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:33.373536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:33.373572 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:33.373549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:33.374065 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:33.373646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:33.374065 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:33.373802 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:34.373646 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:34.373603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:34.374086 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:34.373754 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:35.374193 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.374105 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:35.374650 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.374106 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:35.374650 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:35.374240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:35.374650 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:35.374353 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:35.537010 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.536964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" event={"ID":"437b4f65-cc28-4006-a00e-d98543344c1c","Type":"ContainerStarted","Data":"61682e44dacea7dd48d1a97861623e3ddcb5cf414c2b456bb7c23ca288855c8a"} Jun 11 19:26:35.539218 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.539182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" event={"ID":"1b616c8523a04a6fccd77daac93baa70","Type":"ContainerStarted","Data":"f34f83469ee6810fc1120f4f3f950f2487ba994e98b5284b70103888f5d7efd9"} Jun 11 19:26:35.540911 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.540862 2581 generic.go:356] "Generic (PLEG): container finished" podID="efe61faafc04c23bbb65089376456371" containerID="c72755648552b3df72ec32d0edc1b38a967236ee81ce4c2d65b358034af63c44" exitCode=0 Jun 11 19:26:35.541058 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.540972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"efe61faafc04c23bbb65089376456371","Type":"ContainerDied","Data":"c72755648552b3df72ec32d0edc1b38a967236ee81ce4c2d65b358034af63c44"} Jun 11 19:26:35.543080 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.543054 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="391b6cdfc5874b7d0911962d56cee5dad64fd99c4ed4cd541f74c1df05e0f38d" exitCode=0 Jun 11 19:26:35.543173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.543122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"391b6cdfc5874b7d0911962d56cee5dad64fd99c4ed4cd541f74c1df05e0f38d"} Jun 11 19:26:35.545313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.545280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" event={"ID":"78a0bade-3c96-4a98-96f0-eb524364f82b","Type":"ContainerStarted","Data":"d0ac888e9f6fe7f281799df8b5330f2dd8022be26d75995660799c0446859e8a"} Jun 11 19:26:35.547209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.547184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t99q" event={"ID":"7c828eda-3cbd-42a8-99f1-5527a6bff9b4","Type":"ContainerStarted","Data":"4ad75b1fc536e2a37a331e398a8e9b9b285bf5f99455328f62e7ec80fe47336f"} Jun 11 19:26:35.548742 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.548711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p872s" event={"ID":"15308ac6-f899-48b1-88dd-86de014005fe","Type":"ContainerStarted","Data":"e4c2bf53364345ba7ac1a8bcc71e236e7f0aae0fa719fbc79814a751b5e79ffe"} Jun 11 19:26:35.550529 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.550504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm92m" event={"ID":"1b8c22b3-6421-4f25-9a9d-26978fd434e3","Type":"ContainerStarted","Data":"1fa2f556dd578f8428c4312a047e2687f5a2a7d04de90f8a996163684619cd0e"} Jun 11 19:26:35.554476 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.554425 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-228.ec2.internal" podStartSLOduration=12.554406884 podStartE2EDuration="12.554406884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:35.554345395 +0000 UTC m=+13.606130457" watchObservedRunningTime="2026-06-11 19:26:35.554406884 +0000 UTC m=+13.606191946" Jun 11 19:26:35.567381 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.567331 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dm92m" podStartSLOduration=2.519108154 podStartE2EDuration="13.567310301s" totalImagesPullingTime="11.048202147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:35.566616906 +0000 UTC m=+13.618401971" watchObservedRunningTime="2026-06-11 19:26:35.567310301 +0000 UTC m=+13.619095365" Jun 11 19:26:35.596581 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.596524 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5xcc8" podStartSLOduration=2.525171606 podStartE2EDuration="13.596506441s" totalImagesPullingTime="11.071334835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:35.596014127 +0000 UTC m=+13.647799189" watchObservedRunningTime="2026-06-11 19:26:35.596506441 +0000 UTC m=+13.648291529" Jun 11 19:26:35.609294 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.609238 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p872s" podStartSLOduration=2.602654854 podStartE2EDuration="13.609220955s" totalImagesPullingTime="11.006566101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:35.609199145 +0000 UTC m=+13.660984206" watchObservedRunningTime="2026-06-11 19:26:35.609220955 +0000 UTC m=+13.661006017" Jun 11 19:26:35.647017 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:35.646962 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9t99q" podStartSLOduration=2.571770014 podStartE2EDuration="13.646938769s" totalImagesPullingTime="11.075168755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:35.646466676 +0000 UTC m=+13.698251738" watchObservedRunningTime="2026-06-11 19:26:35.646938769 +0000 UTC m=+13.698723830" Jun 11 19:26:36.374154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.373962 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:36.374317 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:36.374256 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:36.554235 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.554191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mbghz" event={"ID":"c866068e-2897-479c-975c-420c5395c4f0","Type":"ContainerStarted","Data":"f9505f21c337c361aa9d84f9531a5447cd944bc10eabbd424cbe920a01bddb8b"} Jun 11 19:26:36.557137 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.557092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" event={"ID":"efe61faafc04c23bbb65089376456371","Type":"ContainerStarted","Data":"71fe7cddcfa21968a7865a20c87ddbe57198e1b9014b3f56bd1d8ea8795d108a"} Jun 11 19:26:36.569033 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.568753 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mbghz" podStartSLOduration=3.546184066 podStartE2EDuration="14.568732924s" totalImagesPullingTime="11.022548858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:36.56775326 +0000 UTC m=+14.619538358" watchObservedRunningTime="2026-06-11 19:26:36.568732924 +0000 UTC m=+14.620517986" Jun 11 19:26:36.582427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.582360 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-228.ec2.internal" podStartSLOduration=13.582338435 podStartE2EDuration="13.582338435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:36.581659122 +0000 UTC m=+14.633444208" watchObservedRunningTime="2026-06-11 19:26:36.582338435 +0000 UTC m=+14.634123498" Jun 11 19:26:36.787272 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.787233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:36.787834 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:36.787810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:37.373394 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:37.373362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:37.373553 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:37.373484 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:37.373623 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:37.373545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:37.373682 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:37.373662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:37.558885 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:37.558837 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:37.559351 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:37.559325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9t99q" Jun 11 19:26:38.374438 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:38.374396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:38.374586 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:38.374521 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:39.144567 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:39.144524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:39.144585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:39.144623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144710 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144738 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144750 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144761 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144761 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144812 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:26:55.144793786 +0000 UTC m=+33.196578850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144834 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:26:55.144823968 +0000 UTC m=+33.196609023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:39.145148 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.144847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:55.144839838 +0000 UTC m=+33.196624877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:39.373835 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:39.373792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:39.373835 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:39.373827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:39.374159 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.373937 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:39.374159 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:39.374063 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:40.373819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:40.373783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:40.374378 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:40.373965 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:41.374169 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:41.374129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:41.374668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:41.374552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:41.374735 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:41.374671 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:41.374919 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:41.374707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:42.374268 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:42.374233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:42.374683 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:42.374326 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:43.374114 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:43.374072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:43.374295 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:43.374122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:43.374295 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:43.374218 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:43.374772 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:43.374350 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:44.375008 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:44.374973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:44.375479 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:44.375132 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:45.374350 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:45.374313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:45.374554 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:45.374370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:45.374554 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:45.374436 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:45.374554 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:45.374468 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:45.598109 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:45.598058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:45.686734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:45.686654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:45.788381 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:45.788347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:46.374367 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:46.374332 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:46.374576 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:46.374480 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:46.426231 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:46.426189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:46.814963 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:46.814908 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:26:47.318338 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.318140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:47.374056 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.374024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:47.374199 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:47.374157 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:47.374199 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.374191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:47.374303 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:47.374260 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:47.382075 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.381978 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:26:46.814929248Z","UUID":"166041ea-52ad-43ad-b74e-66062e7938c3","Handler":null,"Name":"","Endpoint":""} Jun 11 19:26:47.384811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.384781 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:26:47.384949 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.384829 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:26:47.582725 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.582672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" event={"ID":"437b4f65-cc28-4006-a00e-d98543344c1c","Type":"ContainerStarted","Data":"ed66d157c83db809229bc10f7ea42be10e6c22dfe69e9ae5020fcbc0b0f87e14"} Jun 11 19:26:47.586454 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.586423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:26:47.586907 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.586849 2581 generic.go:356] "Generic (PLEG): container finished" podID="57ce7edf-4c08-4045-ac74-657d10f3484e" containerID="6f6db88f5e76cdf8ffd56e60c69b92df53a0e58438377bc9d8c7e3659183136d" exitCode=1 Jun 11 19:26:47.587033 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.586911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"669e630b918894414a95e8e7ef868420ccb6c810915a9f57a907d6e9ff17ac60"} Jun 11 19:26:47.587033 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.587000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"17cfdb0d0a0ee33c4e30e689e3b979ce68b5fed01b9c6986d4e73404992ad2c4"} Jun 11 19:26:47.587148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.587059 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"6b42216cddb8f031e5e96a6fc13f7ca36fa273769d9a8abf83fc82afef65002e"} Jun 11 19:26:47.587148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.587109 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"a828f1046eb0c2eeb855d4b28511d439180004aaf259c1537059bb0de3d8125c"} Jun 11 19:26:47.587243 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.587157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerDied","Data":"6f6db88f5e76cdf8ffd56e60c69b92df53a0e58438377bc9d8c7e3659183136d"} Jun 11 19:26:47.587243 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.587207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"f57339c61514dc2e725c36991f1b54b222ce6b9287127848ffb3db4764a21cc1"} Jun 11 19:26:47.588634 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.588605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mwbbg" event={"ID":"70ea44d8-8a55-4626-9719-26e3dabd4cd1","Type":"ContainerStarted","Data":"469703016aa72ddaf47b90bc921a1746753bd57003f4e5d479604c6216d5c315"} Jun 11 19:26:47.590651 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.590627 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="c7f2ef64dce64a1784c003cbd15a6482bd8cc9f62e81beb8661f7afebb8738d7" exitCode=0 Jun 11 19:26:47.590760 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.590658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"c7f2ef64dce64a1784c003cbd15a6482bd8cc9f62e81beb8661f7afebb8738d7"} Jun 11 19:26:47.607346 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.607288 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mwbbg" podStartSLOduration=2.652118546 podStartE2EDuration="25.60726843s" totalImagesPullingTime="22.955149884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:47.607152044 +0000 UTC m=+25.658937103" watchObservedRunningTime="2026-06-11 19:26:47.60726843 +0000 UTC m=+25.659053490" Jun 11 19:26:47.728634 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.728559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:47.829349 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:47.829318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:48.374255 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:48.374169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:48.374424 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:48.374302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:48.595231 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:48.595197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" event={"ID":"437b4f65-cc28-4006-a00e-d98543344c1c","Type":"ContainerStarted","Data":"4381eb41203f3afeee94f1f5e00b49c93af3d99e76b09476f67d405537a3a545"} Jun 11 19:26:48.613262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:48.613213 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lszwl" podStartSLOduration=4.370761662 podStartE2EDuration="26.613193259s" totalImagesPullingTime="22.242431597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:48.61261058 +0000 UTC m=+26.664395654" watchObservedRunningTime="2026-06-11 19:26:48.613193259 +0000 UTC m=+26.664978320" Jun 11 19:26:48.926542 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:48.926507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:49.374438 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.374397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:49.374438 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.374426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:49.374636 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:49.374499 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:49.374636 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:49.374619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:49.475633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.475599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:49.529534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.529500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:49.598942 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.598911 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="fa4155ccc35c65e15566005a8cd295eb417abcb8af794b08d34163dc0419fb14" exitCode=0 Jun 11 19:26:49.599076 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.598947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"fa4155ccc35c65e15566005a8cd295eb417abcb8af794b08d34163dc0419fb14"} Jun 11 19:26:49.948967 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:49.948931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:50.120324 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.120292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:50.374219 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.374186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:50.374385 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:50.374334 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:50.604028 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.603957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:26:50.604343 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.604321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"4436ed16eb26e96ed9f169970e4a6c018e321ef019dd56b5d7ef813791419f9f"} Jun 11 19:26:50.606615 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.606590 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="fe72fc8a51f4d5d405298755acdc3b1c0892833f9dce2052fe13b0bdf041fa00" exitCode=0 Jun 11 19:26:50.606733 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:50.606625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"fe72fc8a51f4d5d405298755acdc3b1c0892833f9dce2052fe13b0bdf041fa00"} Jun 11 19:26:51.374406 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:51.374362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:51.374796 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:51.374362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:51.374796 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:51.374481 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:51.374796 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:51.374540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:52.374776 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.374556 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:52.375482 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:52.374883 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:52.616513 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.616482 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:26:52.616981 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.616947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"ca574ec1a357bec181f628b3e839b31b21e2e17b23d3b5b4393540cb393c010f"} Jun 11 19:26:52.617262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.617238 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:52.617449 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.617432 2581 scope.go:117] "RemoveContainer" containerID="6f6db88f5e76cdf8ffd56e60c69b92df53a0e58438377bc9d8c7e3659183136d" Jun 11 19:26:52.636971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:52.636943 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:53.374233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.374195 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:53.374233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.374236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:53.374440 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:53.374315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:53.374491 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:53.374435 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:53.624475 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.624396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:26:53.624976 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.624841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" event={"ID":"57ce7edf-4c08-4045-ac74-657d10f3484e","Type":"ContainerStarted","Data":"c5f65ea16f5ed41e376667b800e7fd63ed438656f7bb5003b76b3bacdf49d871"} Jun 11 19:26:53.625087 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.625067 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:53.625142 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.625136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:53.642780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.642755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:26:53.653503 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.653452 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" podStartSLOduration=8.703389163 podStartE2EDuration="31.653433851s" totalImagesPullingTime="22.950044688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:53.652855001 +0000 UTC m=+31.704640061" watchObservedRunningTime="2026-06-11 19:26:53.653433851 +0000 UTC m=+31.705218912" Jun 11 19:26:53.798583 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.798535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlv5h"] Jun 11 19:26:53.798744 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.798724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:53.798896 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:53.798846 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:53.802252 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.802223 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9hplq"] Jun 11 19:26:53.802407 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.802350 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:53.802468 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:53.802447 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:53.802606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.802583 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tbdd"] Jun 11 19:26:53.802698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:53.802685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:53.802796 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:53.802773 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:55.165775 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.165729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.165800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.165829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.165935 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.165956 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.165974 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.165991 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mn9bl for pod openshift-network-diagnostics/network-check-target-tlv5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.166027 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:27:27.166011074 +0000 UTC m=+65.217796114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.165956 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.166051 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl podName:dc0951a4-a10f-4ac3-8507-01b81cb14d6f nodeName:}" failed. No retries permitted until 2026-06-11 19:27:27.16603428 +0000 UTC m=+65.217819318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mn9bl" (UniqueName: "kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl") pod "network-check-target-tlv5h" (UID: "dc0951a4-a10f-4ac3-8507-01b81cb14d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:26:55.166273 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.166110 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret podName:74716a10-825f-4bd5-8d4a-59fcceccaa7a nodeName:}" failed. No retries permitted until 2026-06-11 19:27:27.166091534 +0000 UTC m=+65.217876592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret") pod "global-pull-secret-syncer-9hplq" (UID: "74716a10-825f-4bd5-8d4a-59fcceccaa7a") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.373594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.373718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.373727 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:55.373751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.373842 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:55.374095 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:55.373968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:56.634389 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:56.634172 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="3460567fd12c32283bf9513cf2503deecfa43b1d920c5ad843e251a8eddcc56d" exitCode=0 Jun 11 19:26:56.634852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:56.634259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"3460567fd12c32283bf9513cf2503deecfa43b1d920c5ad843e251a8eddcc56d"} Jun 11 19:26:57.373485 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.373444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:57.373658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.373455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:57.373658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.373590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:57.373658 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:57.373646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:57.373763 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:57.373554 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:57.373763 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:57.373719 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:57.449328 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.449292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:57.517211 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.517157 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:57.639976 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.639889 2581 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d9eb-fd03-400a-94d8-5334fc3ef322" containerID="4da2f4ba841718bd016fe1bf9c3617f7d47720f9f8cbaac14126d10ce0dc3fdb" exitCode=0 Jun 11 19:26:57.639976 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:57.639928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerDied","Data":"4da2f4ba841718bd016fe1bf9c3617f7d47720f9f8cbaac14126d10ce0dc3fdb"} Jun 11 19:26:58.535609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:58.535575 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:58.588681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:58.588642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:58.645357 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:58.645319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" event={"ID":"9dd8d9eb-fd03-400a-94d8-5334fc3ef322","Type":"ContainerStarted","Data":"b609ce8ba020422da0db70bf1b89638cca04da87ce536e4b24e04a788b970ca3"} Jun 11 19:26:58.668149 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:58.668091 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rlk5n" podStartSLOduration=6.993064271 podStartE2EDuration="36.668072952s" totalImagesPullingTime="29.675008681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:58.6679328 +0000 UTC m=+36.719717861" watchObservedRunningTime="2026-06-11 19:26:58.668072952 +0000 UTC m=+36.719858012" Jun 11 19:26:59.373832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:59.373792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:26:59.374032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:59.373800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:26:59.374032 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:59.373930 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:26:59.374032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:59.373936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:26:59.374032 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:59.373996 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hplq" podUID="74716a10-825f-4bd5-8d4a-59fcceccaa7a" Jun 11 19:26:59.374247 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:26:59.374109 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlv5h" podUID="dc0951a4-a10f-4ac3-8507-01b81cb14d6f" Jun 11 19:26:59.775171 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:59.775081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:59.830212 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:26:59.830180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:00.250010 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.249982 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-228.ec2.internal" event="NodeReady" Jun 11 19:27:00.250173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.250123 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:27:00.292417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.292382 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5tjqf"] Jun 11 19:27:00.320154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.320123 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gb7cx"] Jun 11 19:27:00.320341 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.320264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.322579 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.322558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:27:00.322777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.322765 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xk5k9\"" Jun 11 19:27:00.322828 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.322774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:27:00.329696 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.329673 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tjqf"] Jun 11 19:27:00.329821 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.329710 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gb7cx"] Jun 11 19:27:00.329821 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.329795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.332277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.332237 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:27:00.332277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.332268 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:27:00.332471 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.332237 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:27:00.332471 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.332237 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wz2zc\"" Jun 11 19:27:00.350392 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.350350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:00.403498 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-cert\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.403498 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-tmp-dir\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.403683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xm8\" (UniqueName: \"kubernetes.io/projected/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-kube-api-access-24xm8\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.403683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlxn\" (UniqueName: \"kubernetes.io/projected/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-kube-api-access-vzlxn\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.403683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-config-volume\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.403683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.403620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.440781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.440750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:00.504376 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-config-volume\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.504376 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.504578 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-cert\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.504578 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-tmp-dir\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.504578 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xm8\" (UniqueName: \"kubernetes.io/projected/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-kube-api-access-24xm8\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.504704 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlxn\" (UniqueName: \"kubernetes.io/projected/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-kube-api-access-vzlxn\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.504754 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:00.504709 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:00.504802 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:00.504793 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:01.004770748 +0000 UTC m=+39.056555790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:00.504905 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.504854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-tmp-dir\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.505026 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.505003 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-config-volume\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.508934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.508916 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-cert\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.513237 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.513212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xm8\" (UniqueName: \"kubernetes.io/projected/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-kube-api-access-24xm8\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:00.513605 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.513583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlxn\" (UniqueName: \"kubernetes.io/projected/23ff1f2a-4c3b-4c93-a951-b8508c0be0b2-kube-api-access-vzlxn\") pod \"ingress-canary-gb7cx\" (UID: \"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2\") " pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.638842 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.638800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gb7cx" Jun 11 19:27:00.861332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:00.861284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gb7cx"] Jun 11 19:27:00.866174 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:27:00.866148 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ff1f2a_4c3b_4c93_a951_b8508c0be0b2.slice/crio-d7aa75eaf6aa21f7406390f2e7cf4b40106c4d46afb6bc11994786222cad01d9 WatchSource:0}: Error finding container d7aa75eaf6aa21f7406390f2e7cf4b40106c4d46afb6bc11994786222cad01d9: Status 404 returned error can't find the container with id d7aa75eaf6aa21f7406390f2e7cf4b40106c4d46afb6bc11994786222cad01d9 Jun 11 19:27:01.008649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.008532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:01.008802 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:01.008684 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:01.008802 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:01.008748 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:02.008733682 +0000 UTC m=+40.060518721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:01.103323 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.103285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:01.203531 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.203492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:01.373774 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.373727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:27:01.373774 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.373771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:27:01.374067 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.373842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:27:01.376920 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.376901 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:27:01.377488 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.377470 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:27:01.377540 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.377481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:27:01.377844 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.377829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:27:01.377902 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.377830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdvp2\"" Jun 11 19:27:01.377960 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.377933 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b5pkn\"" Jun 11 19:27:01.654170 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:01.654063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gb7cx" event={"ID":"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2","Type":"ContainerStarted","Data":"d7aa75eaf6aa21f7406390f2e7cf4b40106c4d46afb6bc11994786222cad01d9"} Jun 11 19:27:02.014862 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:02.014774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:02.015409 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:02.014925 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:02.015409 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:02.015009 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:04.014987134 +0000 UTC m=+42.066772175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:02.203545 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:02.203509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:04.033049 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:04.032811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:04.033558 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:04.032982 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:04.033558 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:04.033148 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:08.033131809 +0000 UTC m=+46.084916848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:04.662056 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:04.662020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gb7cx" event={"ID":"23ff1f2a-4c3b-4c93-a951-b8508c0be0b2","Type":"ContainerStarted","Data":"daa6ec9f942e44df1e98698ac4bfc072c19d7b2d21ea2a23012e55e8fd9e0159"} Jun 11 19:27:04.678936 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:04.678881 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gb7cx" podStartSLOduration=1.9319071920000002 podStartE2EDuration="4.678850522s" totalImagesPullingTime="2.74694333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:04.678318811 +0000 UTC m=+42.730103875" watchObservedRunningTime="2026-06-11 19:27:04.678850522 +0000 UTC m=+42.730635583" Jun 11 19:27:06.417026 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:06.416993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:06.483392 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:06.483350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:08.062951 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:08.062911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:08.063365 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:08.063058 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:08.063365 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:08.063113 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:16.06309975 +0000 UTC m=+54.114884790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:08.580108 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:08.580041 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:08.628221 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:08.628181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:15.192404 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:15.192364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:15.243565 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:15.243530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:16.118412 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:16.118365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:16.118674 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:16.118522 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:16.118674 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:16.118590 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:27:32.118574266 +0000 UTC m=+70.170359305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:16.384521 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:16.384431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:16.454258 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:16.454224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:18.583131 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:18.583095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:18.637259 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:18.637222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:25.640489 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:25.640464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww7dt" Jun 11 19:27:25.805755 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:25.805716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:25.901545 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:25.901453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:27.194070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.194025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:27:27.194070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.194070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:27:27.194523 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.194232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:27:27.196586 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.196562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:27:27.196641 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.196578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:27:27.196641 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.196607 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:27:27.204592 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:27.204557 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:27:27.204731 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:27.204639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:28:31.204621064 +0000 UTC m=+129.256406106 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : secret "metrics-daemon-secret" not found Jun 11 19:27:27.206525 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.206505 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:27:27.208595 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.208573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74716a10-825f-4bd5-8d4a-59fcceccaa7a-original-pull-secret\") pod \"global-pull-secret-syncer-9hplq\" (UID: \"74716a10-825f-4bd5-8d4a-59fcceccaa7a\") " pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:27:27.217233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.217209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn9bl\" (UniqueName: \"kubernetes.io/projected/dc0951a4-a10f-4ac3-8507-01b81cb14d6f-kube-api-access-mn9bl\") pod \"network-check-target-tlv5h\" (UID: \"dc0951a4-a10f-4ac3-8507-01b81cb14d6f\") " pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:27:27.486692 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.486608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b5pkn\"" Jun 11 19:27:27.494621 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.494596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:27:27.494786 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.494768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hplq" Jun 11 19:27:27.659673 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.659640 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlv5h"] Jun 11 19:27:27.663202 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:27:27.663166 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0951a4_a10f_4ac3_8507_01b81cb14d6f.slice/crio-c972f073756a9a4036019476df074264367ce842149befc15bd9fce0db71d3a5 WatchSource:0}: Error finding container c972f073756a9a4036019476df074264367ce842149befc15bd9fce0db71d3a5: Status 404 returned error can't find the container with id c972f073756a9a4036019476df074264367ce842149befc15bd9fce0db71d3a5 Jun 11 19:27:27.693469 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.693432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9hplq"] Jun 11 19:27:27.697811 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:27:27.697778 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74716a10_825f_4bd5_8d4a_59fcceccaa7a.slice/crio-d67f9f0b1d2ee0e69ae821313882f48e405884fec290859cc2ae3311b170222e WatchSource:0}: Error finding container d67f9f0b1d2ee0e69ae821313882f48e405884fec290859cc2ae3311b170222e: Status 404 returned error can't find the container with id d67f9f0b1d2ee0e69ae821313882f48e405884fec290859cc2ae3311b170222e Jun 11 19:27:27.715445 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.715410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlv5h" event={"ID":"dc0951a4-a10f-4ac3-8507-01b81cb14d6f","Type":"ContainerStarted","Data":"c972f073756a9a4036019476df074264367ce842149befc15bd9fce0db71d3a5"} Jun 11 19:27:27.716456 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:27.716433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9hplq" event={"ID":"74716a10-825f-4bd5-8d4a-59fcceccaa7a","Type":"ContainerStarted","Data":"d67f9f0b1d2ee0e69ae821313882f48e405884fec290859cc2ae3311b170222e"} Jun 11 19:27:32.124306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.124264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:27:32.124859 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:32.124429 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:27:32.124859 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:27:32.124503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:28:04.124487523 +0000 UTC m=+102.176272562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:27:32.731631 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.731532 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9hplq" event={"ID":"74716a10-825f-4bd5-8d4a-59fcceccaa7a","Type":"ContainerStarted","Data":"df96948ac63bfac8bc1316ea09b85572d607f56bf7d64d41d86892d31ff06ac9"} Jun 11 19:27:32.733098 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.733068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlv5h" event={"ID":"dc0951a4-a10f-4ac3-8507-01b81cb14d6f","Type":"ContainerStarted","Data":"4d6fd80df78eea0681f614452fd12b80e45687f7502ead4a238612e704c35d51"} Jun 11 19:27:32.733230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.733197 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:27:32.745151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.745097 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9hplq" podStartSLOduration=66.00198797 podStartE2EDuration="1m10.745083977s" totalImagesPullingTime="4.743096007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:32.745023481 +0000 UTC m=+70.796808543" watchObservedRunningTime="2026-06-11 19:27:32.745083977 +0000 UTC m=+70.796869038" Jun 11 19:27:32.760670 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:32.760620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tlv5h" podStartSLOduration=65.987029732 podStartE2EDuration="1m10.760605748s" totalImagesPullingTime="4.773576016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:32.759896366 +0000 UTC m=+70.811681418" watchObservedRunningTime="2026-06-11 19:27:32.760605748 +0000 UTC m=+70.812390808" Jun 11 19:27:34.514733 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:34.514689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:34.569155 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:27:34.569117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:03.738128 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:28:03.738094 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tlv5h" Jun 11 19:28:04.142656 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:28:04.142618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:28:04.142824 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:28:04.142768 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:28:04.142916 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:28:04.142845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:29:08.142827627 +0000 UTC m=+166.194612667 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:28:31.234785 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:28:31.234730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:28:31.235249 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:28:31.234933 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:28:31.235249 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:28:31.235004 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:30:33.234988468 +0000 UTC m=+251.286773507 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : secret "metrics-daemon-secret" not found Jun 11 19:29:03.329323 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:29:03.329261 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tjqf" podUID="149b0712-e3b7-4ee7-ad7a-a931c159ac4c" Jun 11 19:29:03.952555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:29:03.952524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:29:04.389498 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:29:04.389454 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:29:08.199379 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:29:08.199280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:29:08.199751 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:29:08.199407 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:29:08.199751 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:29:08.199462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls podName:149b0712-e3b7-4ee7-ad7a-a931c159ac4c nodeName:}" failed. No retries permitted until 2026-06-11 19:31:10.199447649 +0000 UTC m=+288.251232688 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls") pod "dns-default-5tjqf" (UID: "149b0712-e3b7-4ee7-ad7a-a931c159ac4c") : secret "dns-default-metrics-tls" not found Jun 11 19:29:18.377170 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:29:18.377136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:29:38.077546 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:29:38.077512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:17.725754 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.725721 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-ksr47"] Jun 11 19:30:17.727499 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.727481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" Jun 11 19:30:17.730171 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.730147 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-h7br9"] Jun 11 19:30:17.731016 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.730998 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mrz4z\"" Jun 11 19:30:17.731749 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.731735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.734806 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.734596 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 19:30:17.735107 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.735079 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 19:30:17.735202 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.735115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kqk4n\"" Jun 11 19:30:17.735625 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.735609 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:30:17.736277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.736244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:30:17.741759 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.739526 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-ksr47"] Jun 11 19:30:17.743213 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.742981 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 19:30:17.751737 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.751697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-h7br9"] Jun 11 19:30:17.782083 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmjz\" (UniqueName: \"kubernetes.io/projected/9d591940-1780-40eb-ae87-9188e3108307-kube-api-access-4xmjz\") pod \"network-check-source-6947749cfc-ksr47\" (UID: \"9d591940-1780-40eb-ae87-9188e3108307\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" Jun 11 19:30:17.782297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-serving-cert\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.782297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-snapshots\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.782297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.782297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-tmp\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.782297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.782487 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.782290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsrcd\" (UniqueName: \"kubernetes.io/projected/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-kube-api-access-tsrcd\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.846700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.846663 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs"] Jun 11 19:30:17.848407 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.848390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:17.851063 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851036 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:30:17.851209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851105 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 19:30:17.851275 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851226 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:30:17.851340 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851323 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 19:30:17.851544 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-48shv\"" Jun 11 19:30:17.851654 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.851631 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 19:30:17.853025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.853008 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h"] Jun 11 19:30:17.853131 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.853113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.854752 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.854735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:17.857727 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.857706 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:30:17.857846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.857755 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:30:17.857846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.857788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:30:17.858325 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.858308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 19:30:17.858454 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.858311 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8twnq\"" Jun 11 19:30:17.858670 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.858652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsf99\"" Jun 11 19:30:17.858727 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.858714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:30:17.858825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.858714 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 19:30:17.864832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.864811 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:30:17.870443 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.870417 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs"] Jun 11 19:30:17.871414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.871393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h"] Jun 11 19:30:17.883439 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmjz\" (UniqueName: \"kubernetes.io/projected/9d591940-1780-40eb-ae87-9188e3108307-kube-api-access-4xmjz\") pod \"network-check-source-6947749cfc-ksr47\" (UID: \"9d591940-1780-40eb-ae87-9188e3108307\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" Jun 11 19:30:17.883604 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-serving-cert\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.883668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-snapshots\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.883668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.883767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-tmp\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.883767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.883767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.883741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsrcd\" (UniqueName: \"kubernetes.io/projected/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-kube-api-access-tsrcd\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.884265 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.884247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.884344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.884324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-snapshots\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.884398 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.884376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-tmp\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.884616 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.884598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.886071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.886038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-serving-cert\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.887154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.887128 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:30:17.901720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.901686 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsrcd\" (UniqueName: \"kubernetes.io/projected/fd123e75-a069-4b76-ad65-5dcb9ab4ede0-kube-api-access-tsrcd\") pod \"insights-operator-5bbd86d6bd-h7br9\" (UID: \"fd123e75-a069-4b76-ad65-5dcb9ab4ede0\") " pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:17.901851 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.901725 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmjz\" (UniqueName: \"kubernetes.io/projected/9d591940-1780-40eb-ae87-9188e3108307-kube-api-access-4xmjz\") pod \"network-check-source-6947749cfc-ksr47\" (UID: \"9d591940-1780-40eb-ae87-9188e3108307\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" Jun 11 19:30:17.921756 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.921724 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd"] Jun 11 19:30:17.924412 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.924384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:17.926626 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.926602 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 19:30:17.926990 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.926967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bswph\"" Jun 11 19:30:17.927118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.926966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:30:17.927118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.926967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:30:17.927118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.927079 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 19:30:17.935612 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.935578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd"] Jun 11 19:30:17.984166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93cfc19f-5061-4cee-b0e1-81844f260f23-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdnd\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wstf4\" (UniqueName: \"kubernetes.io/projected/cc4302cf-c0f6-4360-92eb-9171c4e9969a-kube-api-access-wstf4\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlpqz\" (UniqueName: \"kubernetes.io/projected/93cfc19f-5061-4cee-b0e1-81844f260f23-kube-api-access-xlpqz\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f640bdfa-03dd-463d-b644-3c5e206abe57-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cktn\" (UniqueName: \"kubernetes.io/projected/f640bdfa-03dd-463d-b644-3c5e206abe57-kube-api-access-9cktn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:17.984676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:17.984912 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:17.984718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f640bdfa-03dd-463d-b644-3c5e206abe57-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.016969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.016933 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:18.038955 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.038922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" Jun 11 19:30:18.046077 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.046048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.085887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlpqz\" (UniqueName: \"kubernetes.io/projected/93cfc19f-5061-4cee-b0e1-81844f260f23-kube-api-access-xlpqz\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.085942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.085982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f640bdfa-03dd-463d-b644-3c5e206abe57-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cktn\" (UniqueName: \"kubernetes.io/projected/f640bdfa-03dd-463d-b644-3c5e206abe57-kube-api-access-9cktn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f640bdfa-03dd-463d-b644-3c5e206abe57-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93cfc19f-5061-4cee-b0e1-81844f260f23-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdnd\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.087066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wstf4\" (UniqueName: \"kubernetes.io/projected/cc4302cf-c0f6-4360-92eb-9171c4e9969a-kube-api-access-wstf4\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.086464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.087015 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.087097 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:18.587072022 +0000 UTC m=+236.638857063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.087755 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.087773 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c5b47cdd4-fljnx: secret "image-registry-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.087824 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.087836 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls podName:40e83877-7e88-409f-b4cf-088cbd8f5a5b nodeName:}" failed. No retries permitted until 2026-06-11 19:30:18.587816764 +0000 UTC m=+236.639601806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls") pod "image-registry-5c5b47cdd4-fljnx" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b") : secret "image-registry-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.087852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.088089 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.088168 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls podName:cc4302cf-c0f6-4360-92eb-9171c4e9969a nodeName:}" failed. No retries permitted until 2026-06-11 19:30:18.588144332 +0000 UTC m=+236.639929372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rmh5h" (UID: "cc4302cf-c0f6-4360-92eb-9171c4e9969a") : secret "samples-operator-tls" not found Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.088324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.088492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.088422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93cfc19f-5061-4cee-b0e1-81844f260f23-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.089274 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.088687 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f640bdfa-03dd-463d-b644-3c5e206abe57-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.090328 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.090275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.090804 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.090755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f640bdfa-03dd-463d-b644-3c5e206abe57-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.091462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.091423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.096749 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.096724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlpqz\" (UniqueName: \"kubernetes.io/projected/93cfc19f-5061-4cee-b0e1-81844f260f23-kube-api-access-xlpqz\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.097731 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.097369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdnd\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.097731 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.097683 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cktn\" (UniqueName: \"kubernetes.io/projected/f640bdfa-03dd-463d-b644-3c5e206abe57-kube-api-access-9cktn\") pod \"kube-storage-version-migrator-operator-7c578b78fc-m9bfs\" (UID: \"f640bdfa-03dd-463d-b644-3c5e206abe57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.099395 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.099013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wstf4\" (UniqueName: \"kubernetes.io/projected/cc4302cf-c0f6-4360-92eb-9171c4e9969a-kube-api-access-wstf4\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:18.099395 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.099350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.119389 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.119353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:18.159440 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.159177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" Jun 11 19:30:18.175672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.175643 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-ksr47"] Jun 11 19:30:18.178643 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:18.178613 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d591940_1780_40eb_ae87_9188e3108307.slice/crio-52a924d0bcab8d782d5e22b7fe74310d96ac76c1c89269dcb3277a40bff7f95c WatchSource:0}: Error finding container 52a924d0bcab8d782d5e22b7fe74310d96ac76c1c89269dcb3277a40bff7f95c: Status 404 returned error can't find the container with id 52a924d0bcab8d782d5e22b7fe74310d96ac76c1c89269dcb3277a40bff7f95c Jun 11 19:30:18.194436 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.194384 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-h7br9"] Jun 11 19:30:18.308494 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.308467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs"] Jun 11 19:30:18.311287 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:18.311255 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf640bdfa_03dd_463d_b644_3c5e206abe57.slice/crio-29522f55d0631d9bd9b5e6d849d5d0e6a7e448ccf5500e5ac7c67ab9e710f04a WatchSource:0}: Error finding container 29522f55d0631d9bd9b5e6d849d5d0e6a7e448ccf5500e5ac7c67ab9e710f04a: Status 404 returned error can't find the container with id 29522f55d0631d9bd9b5e6d849d5d0e6a7e448ccf5500e5ac7c67ab9e710f04a Jun 11 19:30:18.589823 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.589793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:18.590014 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.589843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:18.590014 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:18.589917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:18.590014 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.589997 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590031 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590032 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590053 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c5b47cdd4-fljnx: secret "image-registry-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls podName:cc4302cf-c0f6-4360-92eb-9171c4e9969a nodeName:}" failed. No retries permitted until 2026-06-11 19:30:19.590062487 +0000 UTC m=+237.641847525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rmh5h" (UID: "cc4302cf-c0f6-4360-92eb-9171c4e9969a") : secret "samples-operator-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590107 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:19.590096727 +0000 UTC m=+237.641881773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:18.590184 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:18.590122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls podName:40e83877-7e88-409f-b4cf-088cbd8f5a5b nodeName:}" failed. No retries permitted until 2026-06-11 19:30:19.590114257 +0000 UTC m=+237.641899296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls") pod "image-registry-5c5b47cdd4-fljnx" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b") : secret "image-registry-tls" not found Jun 11 19:30:19.141628 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.141583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" event={"ID":"9d591940-1780-40eb-ae87-9188e3108307","Type":"ContainerStarted","Data":"73d941087df0b3c98651085f07ae35eddb7f08adc541db77ac357e3c04a4a0ef"} Jun 11 19:30:19.142121 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.141645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" event={"ID":"9d591940-1780-40eb-ae87-9188e3108307","Type":"ContainerStarted","Data":"52a924d0bcab8d782d5e22b7fe74310d96ac76c1c89269dcb3277a40bff7f95c"} Jun 11 19:30:19.143023 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.142990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" event={"ID":"fd123e75-a069-4b76-ad65-5dcb9ab4ede0","Type":"ContainerStarted","Data":"4403f92fab50e50c6c66e531172c1b15ab93aa6d0e28ff3e5d57aa2fbdb1abd7"} Jun 11 19:30:19.144173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.144145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" event={"ID":"f640bdfa-03dd-463d-b644-3c5e206abe57","Type":"ContainerStarted","Data":"29522f55d0631d9bd9b5e6d849d5d0e6a7e448ccf5500e5ac7c67ab9e710f04a"} Jun 11 19:30:19.156700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.156642 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-ksr47" podStartSLOduration=2.156620637 podStartE2EDuration="2.156620637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:19.155961909 +0000 UTC m=+237.207746983" watchObservedRunningTime="2026-06-11 19:30:19.156620637 +0000 UTC m=+237.208405697" Jun 11 19:30:19.600587 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.600547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:19.600757 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.600619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:19.600757 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.600691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:19.600757 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600718 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:30:19.600757 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600742 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c5b47cdd4-fljnx: secret "image-registry-tls" not found Jun 11 19:30:19.600994 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600793 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls podName:40e83877-7e88-409f-b4cf-088cbd8f5a5b nodeName:}" failed. No retries permitted until 2026-06-11 19:30:21.600778592 +0000 UTC m=+239.652563630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls") pod "image-registry-5c5b47cdd4-fljnx" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b") : secret "image-registry-tls" not found Jun 11 19:30:19.600994 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600721 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:30:19.600994 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600802 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:19.600994 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600886 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:21.600849138 +0000 UTC m=+239.652634206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:19.600994 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:19.600910 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls podName:cc4302cf-c0f6-4360-92eb-9171c4e9969a nodeName:}" failed. No retries permitted until 2026-06-11 19:30:21.60089734 +0000 UTC m=+239.652682380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rmh5h" (UID: "cc4302cf-c0f6-4360-92eb-9171c4e9969a") : secret "samples-operator-tls" not found Jun 11 19:30:19.970371 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:19.970277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:20.021582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:20.021534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:21.151944 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.151898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" event={"ID":"f640bdfa-03dd-463d-b644-3c5e206abe57","Type":"ContainerStarted","Data":"cd7e827ca3bffd15743a7e3202620116550535265622ccbcb384e34c135f1bc9"} Jun 11 19:30:21.153423 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.153395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" event={"ID":"fd123e75-a069-4b76-ad65-5dcb9ab4ede0","Type":"ContainerStarted","Data":"b1ec4b3996917f7bae93e5f1957100ff076ec15a4bdf90638dfeced6becc1b36"} Jun 11 19:30:21.171746 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.171688 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" podStartSLOduration=1.4699946480000001 podStartE2EDuration="4.171667594s" totalImagesPullingTime="2.701672946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:21.17052313 +0000 UTC m=+239.222308191" watchObservedRunningTime="2026-06-11 19:30:21.171667594 +0000 UTC m=+239.223452657" Jun 11 19:30:21.188462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.188397 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" podStartSLOduration=1.9792809089999999 podStartE2EDuration="4.188379923s" totalImagesPullingTime="2.209099014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:21.187289598 +0000 UTC m=+239.239074660" watchObservedRunningTime="2026-06-11 19:30:21.188379923 +0000 UTC m=+239.240164964" Jun 11 19:30:21.618246 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.618202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.618268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:21.618320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618377 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618405 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c5b47cdd4-fljnx: secret "image-registry-tls" not found Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618425 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:21.618462 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618425 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:30:21.618745 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618464 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls podName:40e83877-7e88-409f-b4cf-088cbd8f5a5b nodeName:}" failed. No retries permitted until 2026-06-11 19:30:25.618444991 +0000 UTC m=+243.670230044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls") pod "image-registry-5c5b47cdd4-fljnx" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b") : secret "image-registry-tls" not found Jun 11 19:30:21.618745 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618502 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:25.618486245 +0000 UTC m=+243.670271284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:21.618745 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:21.618517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls podName:cc4302cf-c0f6-4360-92eb-9171c4e9969a nodeName:}" failed. No retries permitted until 2026-06-11 19:30:25.61850836 +0000 UTC m=+243.670293399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rmh5h" (UID: "cc4302cf-c0f6-4360-92eb-9171c4e9969a") : secret "samples-operator-tls" not found Jun 11 19:30:22.221364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.221327 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ntgtt"] Jun 11 19:30:22.223672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.223646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.227689 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.227657 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:30:22.228281 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.228260 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vpm4\"" Jun 11 19:30:22.228401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.228346 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:30:22.242923 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.242885 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntgtt"] Jun 11 19:30:22.248970 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.248904 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.323326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.323294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.323493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.323348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.323493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.323387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pprf7\" (UniqueName: \"kubernetes.io/projected/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-api-access-pprf7\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.323493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.323425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53635d4a-6373-4825-9b5d-0e548923d7c3-crio-socket\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.323493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.323471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53635d4a-6373-4825-9b5d-0e548923d7c3-data-volume\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.353780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.352247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.424609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.424799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.424799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pprf7\" (UniqueName: \"kubernetes.io/projected/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-api-access-pprf7\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.424799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53635d4a-6373-4825-9b5d-0e548923d7c3-crio-socket\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.424799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53635d4a-6373-4825-9b5d-0e548923d7c3-data-volume\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.425059 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.424817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53635d4a-6373-4825-9b5d-0e548923d7c3-crio-socket\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.425160 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.425142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53635d4a-6373-4825-9b5d-0e548923d7c3-data-volume\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.427842 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.427823 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:30:22.427842 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.427830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:30:22.435547 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:22.435527 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:30:22.435616 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:22.435542 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:30:22.435616 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:22.435597 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:22.935580857 +0000 UTC m=+240.987365899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : configmap "kube-rbac-proxy" not found Jun 11 19:30:22.435616 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:22.435611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:22.935605126 +0000 UTC m=+240.987390165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : secret "insights-runtime-extractor-tls" not found Jun 11 19:30:22.448801 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.448770 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pprf7\" (UniqueName: \"kubernetes.io/projected/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-api-access-pprf7\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:22.462934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.462896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.552725 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.552644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.606158 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.606116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.789107 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.789075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:22.837521 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:22.837499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:23.031223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:23.031187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:23.031415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:23.031243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:23.031415 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:23.031312 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:30:23.031415 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:23.031347 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:30:23.031415 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:23.031372 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:24.031356151 +0000 UTC m=+242.083141207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : configmap "kube-rbac-proxy" not found Jun 11 19:30:23.031415 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:23.031404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:24.031391262 +0000 UTC m=+242.083176301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : secret "insights-runtime-extractor-tls" not found Jun 11 19:30:23.070763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:23.070717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:23.173321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:23.173233 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:24.040856 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.040812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:24.041358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.040907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:24.041358 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:24.041005 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:30:24.041358 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:24.041019 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:30:24.041358 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:24.041084 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:26.041063192 +0000 UTC m=+244.092848230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : configmap "kube-rbac-proxy" not found Jun 11 19:30:24.041358 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:24.041111 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:26.041094381 +0000 UTC m=+244.092879420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : secret "insights-runtime-extractor-tls" not found Jun 11 19:30:24.166041 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.166008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm92m_1b8c22b3-6421-4f25-9a9d-26978fd434e3/dns-node-resolver/0.log" Jun 11 19:30:24.664986 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.664946 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zcj2h"] Jun 11 19:30:24.667779 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.667750 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.670085 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.670057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 19:30:24.670213 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.670059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 19:30:24.670213 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.670107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 19:30:24.670344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.670330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 19:30:24.670991 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.670973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qdvl4\"" Jun 11 19:30:24.676826 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.676798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zcj2h"] Jun 11 19:30:24.703077 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.703048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:24.747160 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.747126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9mv\" (UniqueName: \"kubernetes.io/projected/a2cd296c-4245-42c3-9dab-adae0eaab9f4-kube-api-access-bh9mv\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.747335 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.747203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-key\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.747335 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.747224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-cabundle\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.848011 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.847972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9mv\" (UniqueName: \"kubernetes.io/projected/a2cd296c-4245-42c3-9dab-adae0eaab9f4-kube-api-access-bh9mv\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.848172 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.848066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-key\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.848172 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.848083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-cabundle\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.848779 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.848747 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-cabundle\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.850781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.850758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2cd296c-4245-42c3-9dab-adae0eaab9f4-signing-key\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.856452 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.856426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9mv\" (UniqueName: \"kubernetes.io/projected/a2cd296c-4245-42c3-9dab-adae0eaab9f4-kube-api-access-bh9mv\") pod \"service-ca-7b994bc59-zcj2h\" (UID: \"a2cd296c-4245-42c3-9dab-adae0eaab9f4\") " pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.978035 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.977938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" Jun 11 19:30:24.989737 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:24.989703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:25.045225 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.045148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:25.105445 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.105407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-zcj2h"] Jun 11 19:30:25.108075 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:25.108040 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2cd296c_4245_42c3_9dab_adae0eaab9f4.slice/crio-224b965fda65903b780113a600d1a51128626074fb3538031c7d11c40dfa9a39 WatchSource:0}: Error finding container 224b965fda65903b780113a600d1a51128626074fb3538031c7d11c40dfa9a39: Status 404 returned error can't find the container with id 224b965fda65903b780113a600d1a51128626074fb3538031c7d11c40dfa9a39 Jun 11 19:30:25.174227 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.174195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" event={"ID":"a2cd296c-4245-42c3-9dab-adae0eaab9f4","Type":"ContainerStarted","Data":"224b965fda65903b780113a600d1a51128626074fb3538031c7d11c40dfa9a39"} Jun 11 19:30:25.368298 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.368272 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p872s_15308ac6-f899-48b1-88dd-86de014005fe/node-ca/0.log" Jun 11 19:30:25.568387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.568349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:25.654535 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.654441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:25.654535 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.654511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.654585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654600 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654659 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654671 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls podName:cc4302cf-c0f6-4360-92eb-9171c4e9969a nodeName:}" failed. No retries permitted until 2026-06-11 19:30:33.654654748 +0000 UTC m=+251.706439787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rmh5h" (UID: "cc4302cf-c0f6-4360-92eb-9171c4e9969a") : secret "samples-operator-tls" not found Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654679 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c5b47cdd4-fljnx: secret "image-registry-tls" not found Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654724 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:25.654759 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654741 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls podName:40e83877-7e88-409f-b4cf-088cbd8f5a5b nodeName:}" failed. No retries permitted until 2026-06-11 19:30:33.654720956 +0000 UTC m=+251.706505994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls") pod "image-registry-5c5b47cdd4-fljnx" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b") : secret "image-registry-tls" not found Jun 11 19:30:25.655063 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:25.654785 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:33.654771856 +0000 UTC m=+251.706556896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:25.967764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:25.967679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gb7cx_23ff1f2a-4c3b-4c93-a951-b8508c0be0b2/serve-healthcheck-canary/0.log" Jun 11 19:30:26.058507 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:26.058467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:26.058997 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:26.058550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:26.058997 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:26.058648 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:30:26.058997 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:26.058715 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:30:26.058997 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:26.058724 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:30.058704485 +0000 UTC m=+248.110489545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : secret "insights-runtime-extractor-tls" not found Jun 11 19:30:26.058997 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:26.058822 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:30.058790867 +0000 UTC m=+248.110575909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : configmap "kube-rbac-proxy" not found Jun 11 19:30:27.182700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.182665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" event={"ID":"a2cd296c-4245-42c3-9dab-adae0eaab9f4","Type":"ContainerStarted","Data":"529d8e679912fd4b0d85419e6c80b9e9766edb5c520cbca206065969a668d003"} Jun 11 19:30:27.198888 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.198811 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-zcj2h" podStartSLOduration=1.634010713 podStartE2EDuration="3.198788024s" totalImagesPullingTime="1.564777311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:27.198283307 +0000 UTC m=+245.250068368" watchObservedRunningTime="2026-06-11 19:30:27.198788024 +0000 UTC m=+245.250573086" Jun 11 19:30:27.494999 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.494846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:27.633667 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.633623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:27.734818 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.734778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:27.841308 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:27.841275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:28.193731 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:28.193634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:28.583051 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:28.582963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:29.201344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:29.201312 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:29.588767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:29.588739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:29.785923 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:29.785889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:29.991288 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:29.991196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:30.090781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:30.090743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:30.090992 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:30.090883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:30.090992 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:30.090892 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:30:30.090992 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:30.090975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:38.090955541 +0000 UTC m=+256.142740580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : configmap "kube-rbac-proxy" not found Jun 11 19:30:30.090992 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:30.090992 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:30:30.091155 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:30.091028 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls podName:53635d4a-6373-4825-9b5d-0e548923d7c3 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:38.09101713 +0000 UTC m=+256.142802176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntgtt" (UID: "53635d4a-6373-4825-9b5d-0e548923d7c3") : secret "insights-runtime-extractor-tls" not found Jun 11 19:30:30.184548 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:30.184501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:31.187677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:31.187647 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:31.288816 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:31.288782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:31.390032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:31.389994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:31.445803 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:31.445726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:31.792608 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:31.792516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:32.059630 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:32.059533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:32.160802 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:32.160770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:32.591164 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:32.591122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:32.987791 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:32.987707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:33.188275 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.188240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:33.320266 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.320167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:30:33.320446 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:33.320334 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:30:33.320446 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:33.320436 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs podName:61acf913-396c-41e9-9073-e13bb414c6fa nodeName:}" failed. No retries permitted until 2026-06-11 19:32:35.320416114 +0000 UTC m=+373.372201167 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs") pod "network-metrics-daemon-7tbdd" (UID: "61acf913-396c-41e9-9073-e13bb414c6fa") : secret "metrics-daemon-secret" not found Jun 11 19:30:33.589357 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.589321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:33.722481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.722435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:33.722933 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.722499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:33.722933 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.722547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:33.722933 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:33.722653 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:33.722933 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:33.722717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls podName:93cfc19f-5061-4cee-b0e1-81844f260f23 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:49.722703548 +0000 UTC m=+267.774488587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-vqcqd" (UID: "93cfc19f-5061-4cee-b0e1-81844f260f23") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:30:33.725175 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.725143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc4302cf-c0f6-4360-92eb-9171c4e9969a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rmh5h\" (UID: \"cc4302cf-c0f6-4360-92eb-9171c4e9969a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:33.725382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.725363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"image-registry-5c5b47cdd4-fljnx\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:33.769067 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.769029 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsf99\"" Jun 11 19:30:33.774109 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.774090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8twnq\"" Jun 11 19:30:33.776745 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.776726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:33.782757 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.782731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" Jun 11 19:30:33.925215 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.925178 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:30:33.927788 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:33.927763 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e83877_7e88_409f_b4cf_088cbd8f5a5b.slice/crio-669d58a7821d075a25f67595cb966053ef3d44abefc7cfa02cbbe6d1ec59f859 WatchSource:0}: Error finding container 669d58a7821d075a25f67595cb966053ef3d44abefc7cfa02cbbe6d1ec59f859: Status 404 returned error can't find the container with id 669d58a7821d075a25f67595cb966053ef3d44abefc7cfa02cbbe6d1ec59f859 Jun 11 19:30:33.936099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:33.936079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h"] Jun 11 19:30:34.008119 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.008080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:34.188442 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.188335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:34.208145 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.208104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" event={"ID":"40e83877-7e88-409f-b4cf-088cbd8f5a5b","Type":"ContainerStarted","Data":"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30"} Jun 11 19:30:34.208344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.208163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" event={"ID":"40e83877-7e88-409f-b4cf-088cbd8f5a5b","Type":"ContainerStarted","Data":"669d58a7821d075a25f67595cb966053ef3d44abefc7cfa02cbbe6d1ec59f859"} Jun 11 19:30:34.208344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.208191 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:30:34.209490 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.209461 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" event={"ID":"cc4302cf-c0f6-4360-92eb-9171c4e9969a","Type":"ContainerStarted","Data":"b348e9f19222f3a3f0312df15e3e194183950d60df1fd704d183e9d45d8b0bfc"} Jun 11 19:30:34.225218 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.225166 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" podStartSLOduration=17.225149914 podStartE2EDuration="17.225149914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:34.224781751 +0000 UTC m=+252.276566812" watchObservedRunningTime="2026-06-11 19:30:34.225149914 +0000 UTC m=+252.276934975" Jun 11 19:30:34.586257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.586216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:34.989424 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:34.989330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:35.187292 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:35.187262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:35.287687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:35.287570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:35.594076 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:35.593990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:35.992400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:35.992308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:36.219052 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:36.219017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" event={"ID":"cc4302cf-c0f6-4360-92eb-9171c4e9969a","Type":"ContainerStarted","Data":"7557007376d64083fd4d1a75c35afb015031243280f213489338a732292d832a"} Jun 11 19:30:36.219226 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:36.219071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" event={"ID":"cc4302cf-c0f6-4360-92eb-9171c4e9969a","Type":"ContainerStarted","Data":"b1d4dbe57607e601bcecd88c0cab4903b3f69f206d24d90037fb169c260a02cc"} Jun 11 19:30:36.235888 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:36.235816 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rmh5h" podStartSLOduration=17.531916006 podStartE2EDuration="19.23579682s" totalImagesPullingTime="1.703880814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:36.234572392 +0000 UTC m=+254.286357452" watchObservedRunningTime="2026-06-11 19:30:36.23579682 +0000 UTC m=+254.287581880" Jun 11 19:30:36.387298 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:36.387261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:36.988794 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:36.988754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:37.386606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:37.386571 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:37.788840 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:37.788752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:37.986623 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:37.986545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:38.160110 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.160073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:38.160269 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.160127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:38.160673 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.160654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53635d4a-6373-4825-9b5d-0e548923d7c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:38.162602 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.162584 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53635d4a-6373-4825-9b5d-0e548923d7c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntgtt\" (UID: \"53635d4a-6373-4825-9b5d-0e548923d7c3\") " pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:38.185763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.185724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:38.435118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.435035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vpm4\"" Jun 11 19:30:38.442902 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.442881 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntgtt" Jun 11 19:30:38.573046 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:38.573023 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntgtt"] Jun 11 19:30:38.577115 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:38.577086 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53635d4a_6373_4825_9b5d_0e548923d7c3.slice/crio-ff8ffe8f0832124bcf92c3e11294cf2dd6ae574cf474f1328f7b2f5b9be291cf WatchSource:0}: Error finding container ff8ffe8f0832124bcf92c3e11294cf2dd6ae574cf474f1328f7b2f5b9be291cf: Status 404 returned error can't find the container with id ff8ffe8f0832124bcf92c3e11294cf2dd6ae574cf474f1328f7b2f5b9be291cf Jun 11 19:30:39.231695 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:39.231608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntgtt" event={"ID":"53635d4a-6373-4825-9b5d-0e548923d7c3","Type":"ContainerStarted","Data":"ff8ffe8f0832124bcf92c3e11294cf2dd6ae574cf474f1328f7b2f5b9be291cf"} Jun 11 19:30:42.244680 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:42.244593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntgtt" event={"ID":"53635d4a-6373-4825-9b5d-0e548923d7c3","Type":"ContainerStarted","Data":"04b4886e34e40c74a5ddf3afc4177f901c6da247a04f29b6a2eda9cb264285ba"} Jun 11 19:30:42.300193 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:42.300148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:42.894927 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:42.894859 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:30:42.928829 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:42.928797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.024829 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.024752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.099044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.098998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.190047 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.190013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.252139 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.252094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntgtt" event={"ID":"53635d4a-6373-4825-9b5d-0e548923d7c3","Type":"ContainerStarted","Data":"d94c7a10ea5171675ac2f7cb7c03f1ed40738b862aed4485def5c5d59f507456"} Jun 11 19:30:43.524624 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.524591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.583198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.583148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:43.935354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:43.935314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:44.339513 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:44.339474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:44.734543 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:44.734459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:44.838057 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:44.838017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:45.158053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.158020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:45.213515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.213486 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:45.261343 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.261308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntgtt" event={"ID":"53635d4a-6373-4825-9b5d-0e548923d7c3","Type":"ContainerStarted","Data":"d606d3b68d203f719c08638daad1c7ce4a1e1a643b2c2a92be53004b13caca89"} Jun 11 19:30:45.281981 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.281930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ntgtt" podStartSLOduration=17.497319418 podStartE2EDuration="23.281914009s" totalImagesPullingTime="5.784594591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:30:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:45.280258813 +0000 UTC m=+263.332043874" watchObservedRunningTime="2026-06-11 19:30:45.281914009 +0000 UTC m=+263.333699070" Jun 11 19:30:45.731018 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.730981 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:45.832210 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:45.832178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:49.102624 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:49.102588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:49.207332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:49.207300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:49.752669 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:49.752631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:49.755329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:49.755306 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93cfc19f-5061-4cee-b0e1-81844f260f23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-vqcqd\" (UID: \"93cfc19f-5061-4cee-b0e1-81844f260f23\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:50.036402 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:50.036318 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bswph\"" Jun 11 19:30:50.044915 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:50.044888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" Jun 11 19:30:50.178815 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:50.178780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd"] Jun 11 19:30:50.181525 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:50.181496 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cfc19f_5061_4cee_b0e1_81844f260f23.slice/crio-dcb4f9d9f92bfc51236b9257d83896c9cc7d0fa3ec407acb93ce7b819836852a WatchSource:0}: Error finding container dcb4f9d9f92bfc51236b9257d83896c9cc7d0fa3ec407acb93ce7b819836852a: Status 404 returned error can't find the container with id dcb4f9d9f92bfc51236b9257d83896c9cc7d0fa3ec407acb93ce7b819836852a Jun 11 19:30:50.278288 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:50.278247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" event={"ID":"93cfc19f-5061-4cee-b0e1-81844f260f23","Type":"ContainerStarted","Data":"dcb4f9d9f92bfc51236b9257d83896c9cc7d0fa3ec407acb93ce7b819836852a"} Jun 11 19:30:51.165161 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.165121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:30:51.168600 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.168580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.171364 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.171950 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cs75c\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.171964 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.172259 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.172285 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.172534 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.172734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 19:30:51.174382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.172959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 19:30:51.180235 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.180204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:30:51.265211 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.265401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrvf\" (UniqueName: \"kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.265401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.265401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.265401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.265401 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.265365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366160 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrvf\" (UniqueName: \"kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366523 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.366523 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.366410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.367326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.367250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.367326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.367282 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.367599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.367394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.369130 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.369094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.369268 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.369251 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.374381 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.374336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrvf\" (UniqueName: \"kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf\") pod \"console-645b66b55d-6qthp\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.483635 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.483550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:30:51.955813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:51.955768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.049509 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.049423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.056513 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.056479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:30:52.060074 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:52.060045 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90819c49_a8b3_4d07_8ba6_73bf879ab6e6.slice/crio-37ab37328c85269b6f806341346a35b9e5ae29c9fa26ea538b25416e8409daf2 WatchSource:0}: Error finding container 37ab37328c85269b6f806341346a35b9e5ae29c9fa26ea538b25416e8409daf2: Status 404 returned error can't find the container with id 37ab37328c85269b6f806341346a35b9e5ae29c9fa26ea538b25416e8409daf2 Jun 11 19:30:52.192398 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.192298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.286852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.286813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645b66b55d-6qthp" event={"ID":"90819c49-a8b3-4d07-8ba6-73bf879ab6e6","Type":"ContainerStarted","Data":"37ab37328c85269b6f806341346a35b9e5ae29c9fa26ea538b25416e8409daf2"} Jun 11 19:30:52.288303 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.288278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" event={"ID":"93cfc19f-5061-4cee-b0e1-81844f260f23","Type":"ContainerStarted","Data":"964c7b3bd59a269ec84602398980bc21bd48a12f282f2577ed0fb185528010e5"} Jun 11 19:30:52.300349 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.300312 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.314576 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.314504 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-vqcqd" podStartSLOduration=33.526399283 podStartE2EDuration="35.314479288s" totalImagesPullingTime="1.788080005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:52.31229248 +0000 UTC m=+270.364077555" watchObservedRunningTime="2026-06-11 19:30:52.314479288 +0000 UTC m=+270.366264351" Jun 11 19:30:52.392156 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.392121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.520469 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.520322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.523486 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.523451 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4"] Jun 11 19:30:52.526780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.526757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:52.529274 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.529253 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-68chn\"" Jun 11 19:30:52.529554 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.529531 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 19:30:52.534762 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.534738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4"] Jun 11 19:30:52.576950 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.576908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-phpx4\" (UID: \"0fc23933-b101-4561-bada-4b0a4ebfb2ca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:52.677591 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.677554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-phpx4\" (UID: \"0fc23933-b101-4561-bada-4b0a4ebfb2ca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:52.677797 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:52.677737 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 19:30:52.677908 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:30:52.677826 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates podName:0fc23933-b101-4561-bada-4b0a4ebfb2ca nodeName:}" failed. No retries permitted until 2026-06-11 19:30:53.177800539 +0000 UTC m=+271.229585582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-phpx4" (UID: "0fc23933-b101-4561-bada-4b0a4ebfb2ca") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 19:30:52.805701 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.805614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.900609 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.900576 2581 patch_prober.go:28] interesting pod/image-registry-5c5b47cdd4-fljnx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:30:52.900773 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:52.900642 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:30:53.183224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:53.183181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-phpx4\" (UID: \"0fc23933-b101-4561-bada-4b0a4ebfb2ca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:53.186130 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:53.186100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0fc23933-b101-4561-bada-4b0a4ebfb2ca-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-phpx4\" (UID: \"0fc23933-b101-4561-bada-4b0a4ebfb2ca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:53.437587 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:53.437479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:53.571948 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:53.571912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4"] Jun 11 19:30:53.574888 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:30:53.574842 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc23933_b101_4561_bada_4b0a4ebfb2ca.slice/crio-de85abc3a01053903c8cf8a89de36a19a42baf613e77adc30fc69d584229b9f1 WatchSource:0}: Error finding container de85abc3a01053903c8cf8a89de36a19a42baf613e77adc30fc69d584229b9f1: Status 404 returned error can't find the container with id de85abc3a01053903c8cf8a89de36a19a42baf613e77adc30fc69d584229b9f1 Jun 11 19:30:54.296957 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:54.296901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" event={"ID":"0fc23933-b101-4561-bada-4b0a4ebfb2ca","Type":"ContainerStarted","Data":"de85abc3a01053903c8cf8a89de36a19a42baf613e77adc30fc69d584229b9f1"} Jun 11 19:30:54.357991 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:54.357951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:57.310229 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.310191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645b66b55d-6qthp" event={"ID":"90819c49-a8b3-4d07-8ba6-73bf879ab6e6","Type":"ContainerStarted","Data":"c84d4bf9d69b6cfb46abb85581dd089a1e8529fd7260fa29d11b967111c2587d"} Jun 11 19:30:57.311716 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.311693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" event={"ID":"0fc23933-b101-4561-bada-4b0a4ebfb2ca","Type":"ContainerStarted","Data":"b2fa71fdc6d648733492848065a0228f740bd74cb84f56d88e29d88d74e2546c"} Jun 11 19:30:57.311918 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.311900 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:57.316800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.316775 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" Jun 11 19:30:57.326425 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.326367 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-645b66b55d-6qthp" podStartSLOduration=2.0613466 podStartE2EDuration="6.326351122s" totalImagesPullingTime="4.265004522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:57.326006654 +0000 UTC m=+275.377791716" watchObservedRunningTime="2026-06-11 19:30:57.326351122 +0000 UTC m=+275.378136182" Jun 11 19:30:57.340344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.340289 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-phpx4" podStartSLOduration=2.587931663 podStartE2EDuration="5.34027058s" totalImagesPullingTime="2.752338917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:57.339649804 +0000 UTC m=+275.391434865" watchObservedRunningTime="2026-06-11 19:30:57.34027058 +0000 UTC m=+275.392055641" Jun 11 19:30:57.545672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.545633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:57.609638 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.609606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:57.721664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:30:57.721631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:00.352006 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.351972 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:00.354169 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.354151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.361534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.361509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 19:31:00.366020 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.365994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:00.436382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z6l\" (UniqueName: \"kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.436585 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.436537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.537887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.537887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z6l\" (UniqueName: \"kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.537969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538250 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.538175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538671 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.538646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.538758 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.538729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.539116 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.539097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.539332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.539314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.540700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.540682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.540807 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.540785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.547896 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.547267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z6l\" (UniqueName: \"kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l\") pod \"console-966b8ccc5-wlbrl\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.664044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.663942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:00.803897 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:00.803737 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:00.806531 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:00.806505 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd27fb0_7229_4b50_bee9_7cc79945f6a5.slice/crio-d7ab79605030f5c6407bcf772e41cad599c6f7c819feb62381952f6bb43375a4 WatchSource:0}: Error finding container d7ab79605030f5c6407bcf772e41cad599c6f7c819feb62381952f6bb43375a4: Status 404 returned error can't find the container with id d7ab79605030f5c6407bcf772e41cad599c6f7c819feb62381952f6bb43375a4 Jun 11 19:31:01.163567 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.163538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:01.242724 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.242694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:01.325778 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.325739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-966b8ccc5-wlbrl" event={"ID":"6fd27fb0-7229-4b50-bee9-7cc79945f6a5","Type":"ContainerStarted","Data":"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a"} Jun 11 19:31:01.325959 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.325790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-966b8ccc5-wlbrl" event={"ID":"6fd27fb0-7229-4b50-bee9-7cc79945f6a5","Type":"ContainerStarted","Data":"d7ab79605030f5c6407bcf772e41cad599c6f7c819feb62381952f6bb43375a4"} Jun 11 19:31:01.346233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.346180 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-966b8ccc5-wlbrl" podStartSLOduration=1.346165256 podStartE2EDuration="1.346165256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:01.345757649 +0000 UTC m=+279.397542712" watchObservedRunningTime="2026-06-11 19:31:01.346165256 +0000 UTC m=+279.397950316" Jun 11 19:31:01.484607 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.484504 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:31:01.484607 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.484588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:31:01.485953 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.485918 2581 patch_prober.go:28] interesting pod/console-645b66b55d-6qthp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 11 19:31:01.486081 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:01.485972 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-645b66b55d-6qthp" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 11 19:31:02.418534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:02.418492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:02.899466 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:02.899430 2581 patch_prober.go:28] interesting pod/image-registry-5c5b47cdd4-fljnx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:31:02.899823 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:02.899485 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:31:04.679807 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.679769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:04.779649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.779614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:04.879706 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.879669 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:04.944630 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.944537 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jk22j"] Jun 11 19:31:04.947103 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.947084 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qllf"] Jun 11 19:31:04.947230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.947216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.949319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.949298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.949512 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.949488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j46fw\"" Jun 11 19:31:04.949662 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.949645 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:31:04.949810 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.949773 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:31:04.950282 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.950260 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:31:04.950384 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.950260 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:31:04.951349 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.951330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 19:31:04.951560 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.951544 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 19:31:04.951704 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.951687 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 19:31:04.951776 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.951760 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-shl9j\"" Jun 11 19:31:04.958264 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.957936 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qllf"] Jun 11 19:31:04.960782 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.960756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:04.974079 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-root\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974239 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f530177d-1a21-4bd1-b8aa-82fe0e06d507-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.974239 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.974239 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974239 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-textfile\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974399 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974399 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-metrics-client-ca\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974399 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.974497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-tls\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nw8g\" (UniqueName: \"kubernetes.io/projected/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-kube-api-access-8nw8g\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.974575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-sys\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh74w\" (UniqueName: \"kubernetes.io/projected/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-api-access-sh74w\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:04.974676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-wtmp\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:04.974676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:04.974603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.075966 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.075918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f530177d-1a21-4bd1-b8aa-82fe0e06d507-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.076150 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.075972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.076150 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076272 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-textfile\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076272 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076272 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-metrics-client-ca\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.076415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-tls\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nw8g\" (UniqueName: \"kubernetes.io/projected/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-kube-api-access-8nw8g\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f530177d-1a21-4bd1-b8aa-82fe0e06d507-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.076603 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076467 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-textfile\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076697 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076797 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.076953 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-sys\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.076953 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.076970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh74w\" (UniqueName: \"kubernetes.io/projected/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-api-access-sh74w\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-wtmp\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077069 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077011 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-sys\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.077140 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-root\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.077411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-wtmp\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.077411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-metrics-client-ca\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.077411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.077220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-root\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.079397 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.079312 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-tls\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.079397 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.079349 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.079785 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.079602 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.079785 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.079738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.091491 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.091465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh74w\" (UniqueName: \"kubernetes.io/projected/f530177d-1a21-4bd1-b8aa-82fe0e06d507-kube-api-access-sh74w\") pod \"kube-state-metrics-678bc549d7-9qllf\" (UID: \"f530177d-1a21-4bd1-b8aa-82fe0e06d507\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.094450 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.094423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nw8g\" (UniqueName: \"kubernetes.io/projected/d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e-kube-api-access-8nw8g\") pod \"node-exporter-jk22j\" (UID: \"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e\") " pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.111224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.111193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.213898 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.213774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.261118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.261079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jk22j" Jun 11 19:31:05.266950 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.266930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" Jun 11 19:31:05.276001 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:05.275966 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bcbd89_1ce6_4e0c_b135_99bcd68fb46e.slice/crio-87fd12e73ed429b51a10fb168b9093be620a5d1256ef68cb5c996644eff6e0d1 WatchSource:0}: Error finding container 87fd12e73ed429b51a10fb168b9093be620a5d1256ef68cb5c996644eff6e0d1: Status 404 returned error can't find the container with id 87fd12e73ed429b51a10fb168b9093be620a5d1256ef68cb5c996644eff6e0d1 Jun 11 19:31:05.314007 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.313927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.343505 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.343464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jk22j" event={"ID":"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e","Type":"ContainerStarted","Data":"87fd12e73ed429b51a10fb168b9093be620a5d1256ef68cb5c996644eff6e0d1"} Jun 11 19:31:05.403276 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.403249 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qllf"] Jun 11 19:31:05.406370 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:05.406342 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf530177d_1a21_4bd1_b8aa_82fe0e06d507.slice/crio-548e2399ec2b84e4db945fd39f826733e50ecbfd66282541bfa964b1c4feef3a WatchSource:0}: Error finding container 548e2399ec2b84e4db945fd39f826733e50ecbfd66282541bfa964b1c4feef3a: Status 404 returned error can't find the container with id 548e2399ec2b84e4db945fd39f826733e50ecbfd66282541bfa964b1c4feef3a Jun 11 19:31:05.537699 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.537615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.908099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.908066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.994786 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.994716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:05.999749 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:05.999710 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:31:06.005279 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.005248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.007659 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.007628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:31:06.007934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.007917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:31:06.008306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.008287 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-59m7n\"" Jun 11 19:31:06.008505 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.008487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:31:06.008713 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.008691 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:31:06.008996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.008978 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:31:06.009206 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.009190 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:31:06.009468 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.009450 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:31:06.009675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.009658 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:31:06.009897 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.009857 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:31:06.021528 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.021474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:31:06.086526 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-out\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086526 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086794 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086794 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-web-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086794 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086794 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.086971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.087138 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.086999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btght\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-kube-api-access-btght\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.087138 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.087036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.087138 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.087079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-out\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-web-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:06.188429 2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:06.188503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls podName:f9b3d0f0-34e9-405f-aed6-4b9b886c2984 nodeName:}" failed. No retries permitted until 2026-06-11 19:31:06.688479919 +0000 UTC m=+284.740264961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f9b3d0f0-34e9-405f-aed6-4b9b886c2984") : secret "alertmanager-main-tls" not found Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.188977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.189038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189899 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.189074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btght\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-kube-api-access-btght\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.189899 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.189117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.191165 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.191134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.193683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.193257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-out\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.193969 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:06.193944 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle podName:f9b3d0f0-34e9-405f-aed6-4b9b886c2984 nodeName:}" failed. No retries permitted until 2026-06-11 19:31:06.693921054 +0000 UTC m=+284.745706099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f9b3d0f0-34e9-405f-aed6-4b9b886c2984") : configmap references non-existent config key: ca-bundle.crt Jun 11 19:31:06.195468 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.195434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-config-volume\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.198147 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.198062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.198147 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.198096 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-web-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.198285 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.198259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.198326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.198279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.198435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.198416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.200172 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.200149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.203994 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.203971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btght\" (UniqueName: \"kubernetes.io/projected/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-kube-api-access-btght\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.310770 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.310737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:06.349181 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.349144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" event={"ID":"f530177d-1a21-4bd1-b8aa-82fe0e06d507","Type":"ContainerStarted","Data":"548e2399ec2b84e4db945fd39f826733e50ecbfd66282541bfa964b1c4feef3a"} Jun 11 19:31:06.696144 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.696094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.696322 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.696238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.697226 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.697194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.699183 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.699159 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f9b3d0f0-34e9-405f-aed6-4b9b886c2984-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f9b3d0f0-34e9-405f-aed6-4b9b886c2984\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.925953 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:06.925804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:31:06.953884 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:06.953253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tjqf" podUID="149b0712-e3b7-4ee7-ad7a-a931c159ac4c" Jun 11 19:31:07.104911 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.104845 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:31:07.108724 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:07.108692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b3d0f0_34e9_405f_aed6_4b9b886c2984.slice/crio-40249aca9b535a9dc28080f2edf5c0db1d451a67c805bdcb03c76ff0ed7797f1 WatchSource:0}: Error finding container 40249aca9b535a9dc28080f2edf5c0db1d451a67c805bdcb03c76ff0ed7797f1: Status 404 returned error can't find the container with id 40249aca9b535a9dc28080f2edf5c0db1d451a67c805bdcb03c76ff0ed7797f1 Jun 11 19:31:07.354887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.354831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"40249aca9b535a9dc28080f2edf5c0db1d451a67c805bdcb03c76ff0ed7797f1"} Jun 11 19:31:07.356914 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.356886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" event={"ID":"f530177d-1a21-4bd1-b8aa-82fe0e06d507","Type":"ContainerStarted","Data":"ba3e13974c13593c58e60fcf861f3a03577debc84d2f91d01cc33c72015a7a61"} Jun 11 19:31:07.357040 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.356942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" event={"ID":"f530177d-1a21-4bd1-b8aa-82fe0e06d507","Type":"ContainerStarted","Data":"17e9c2dad1239f8d2bd7c25184184f7bdf2bd5a1904701d782d6fe9422b990db"} Jun 11 19:31:07.357040 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.356961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" event={"ID":"f530177d-1a21-4bd1-b8aa-82fe0e06d507","Type":"ContainerStarted","Data":"14887f47f55f8a15fc2cae6aa6f90a6bf6f8f9edbdbfbfebbd3f3e72dc49e3fb"} Jun 11 19:31:07.358436 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.358412 2581 generic.go:356] "Generic (PLEG): container finished" podID="d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e" containerID="221e83756ec3a473c6c7a4122123969c4866d5a9a74ac91b62324a3604cadfc2" exitCode=0 Jun 11 19:31:07.358532 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.358473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:07.358532 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.358495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jk22j" event={"ID":"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e","Type":"ContainerDied","Data":"221e83756ec3a473c6c7a4122123969c4866d5a9a74ac91b62324a3604cadfc2"} Jun 11 19:31:07.375978 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.375930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qllf" podStartSLOduration=2.019476921 podStartE2EDuration="3.37591215s" totalImagesPullingTime="1.356435229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:07.374423878 +0000 UTC m=+285.426208934" watchObservedRunningTime="2026-06-11 19:31:07.37591215 +0000 UTC m=+285.427697211" Jun 11 19:31:07.873091 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.873054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:07.915390 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.915338 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" containerID="cri-o://3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30" gracePeriod=30 Jun 11 19:31:07.919190 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.919156 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cb6798fc8-dj2m6"] Jun 11 19:31:07.922652 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.922235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:07.924470 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.924448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 19:31:07.924812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.924793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 19:31:07.924935 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.924808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2knpw\"" Jun 11 19:31:07.925010 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.924932 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 19:31:07.925107 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.925090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 19:31:07.925176 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.925158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 19:31:07.925343 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.925328 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8kbs296n1ve2j\"" Jun 11 19:31:07.938929 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.938893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb6798fc8-dj2m6"] Jun 11 19:31:07.960777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:07.960736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:08.009262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009502 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009502 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009502 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da52b9e1-09bc-4a6b-955a-59871c90a289-metrics-client-ca\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009502 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-grpc-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009655 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009702 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.009741 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.009716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2cd\" (UniqueName: \"kubernetes.io/projected/da52b9e1-09bc-4a6b-955a-59871c90a289-kube-api-access-6f2cd\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.011345 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.011316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:08.111189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111328 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2cd\" (UniqueName: \"kubernetes.io/projected/da52b9e1-09bc-4a6b-955a-59871c90a289-kube-api-access-6f2cd\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111392 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111392 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da52b9e1-09bc-4a6b-955a-59871c90a289-metrics-client-ca\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111589 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-grpc-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.111589 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.111540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.112336 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.112304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da52b9e1-09bc-4a6b-955a-59871c90a289-metrics-client-ca\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.114828 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.114775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.115160 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.115024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.115637 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.115610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.115637 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.115625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.116049 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.116025 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.117265 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.117239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da52b9e1-09bc-4a6b-955a-59871c90a289-secret-grpc-tls\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.123628 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.123545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2cd\" (UniqueName: \"kubernetes.io/projected/da52b9e1-09bc-4a6b-955a-59871c90a289-kube-api-access-6f2cd\") pod \"thanos-querier-cb6798fc8-dj2m6\" (UID: \"da52b9e1-09bc-4a6b-955a-59871c90a289\") " pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.177453 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.177305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:08.191824 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.191799 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:31:08.284358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.284320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:08.313390 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313358 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313529 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313413 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsdnd\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313529 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313641 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313623 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313689 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313674 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313744 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313705 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313744 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313739 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.313838 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.313787 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets\") pod \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\" (UID: \"40e83877-7e88-409f-b4cf-088cbd8f5a5b\") " Jun 11 19:31:08.314592 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.314204 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:08.314737 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.314644 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:08.316481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.316424 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:08.316481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.316423 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:08.316607 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.316526 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd" (OuterVolumeSpecName: "kube-api-access-fsdnd") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "kube-api-access-fsdnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:08.316607 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.316524 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:08.317104 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.317084 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:08.324811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.324764 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "40e83877-7e88-409f-b4cf-088cbd8f5a5b" (UID: "40e83877-7e88-409f-b4cf-088cbd8f5a5b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:31:08.363740 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.363708 2581 generic.go:356] "Generic (PLEG): container finished" podID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerID="3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30" exitCode=0 Jun 11 19:31:08.363956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.363760 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" Jun 11 19:31:08.363956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.363807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" event={"ID":"40e83877-7e88-409f-b4cf-088cbd8f5a5b","Type":"ContainerDied","Data":"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30"} Jun 11 19:31:08.363956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.363854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b47cdd4-fljnx" event={"ID":"40e83877-7e88-409f-b4cf-088cbd8f5a5b","Type":"ContainerDied","Data":"669d58a7821d075a25f67595cb966053ef3d44abefc7cfa02cbbe6d1ec59f859"} Jun 11 19:31:08.363956 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.363908 2581 scope.go:117] "RemoveContainer" containerID="3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30" Jun 11 19:31:08.366668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.366638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jk22j" event={"ID":"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e","Type":"ContainerStarted","Data":"051abe29df095b2cfa2543878ef64afad6611a4350e9047b782366219c51c340"} Jun 11 19:31:08.366800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.366705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jk22j" event={"ID":"d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e","Type":"ContainerStarted","Data":"77ee074794f7f29f9ee17cd87298ecffcb259e3bf4aa8b031c25c123968b02d3"} Jun 11 19:31:08.368374 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.368340 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9b3d0f0-34e9-405f-aed6-4b9b886c2984" containerID="ef4431a88ebfc6cf16aab6e8f473c57ad309a735990a06afe86e7d9133419010" exitCode=0 Jun 11 19:31:08.368493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.368471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerDied","Data":"ef4431a88ebfc6cf16aab6e8f473c57ad309a735990a06afe86e7d9133419010"} Jun 11 19:31:08.375196 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.375010 2581 scope.go:117] "RemoveContainer" containerID="3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30" Jun 11 19:31:08.375449 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:08.375386 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30\": container with ID starting with 3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30 not found: ID does not exist" containerID="3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30" Jun 11 19:31:08.375545 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.375431 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30"} err="failed to get container status \"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30\": rpc error: code = NotFound desc = could not find container \"3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30\": container with ID starting with 3c11238436fd327e93299de37b457c9a46ba1e66315640d33e2afb8659d0ba30 not found: ID does not exist" Jun 11 19:31:08.385664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.385613 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jk22j" podStartSLOduration=2.790476617 podStartE2EDuration="4.385596497s" totalImagesPullingTime="1.484493636s" totalInitContainerRuntime="110.626244ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:08.384286497 +0000 UTC m=+286.436071560" watchObservedRunningTime="2026-06-11 19:31:08.385596497 +0000 UTC m=+286.437381558" Jun 11 19:31:08.416497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416444 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsdnd\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-kube-api-access-fsdnd\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416484 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-tls\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416501 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e83877-7e88-409f-b4cf-088cbd8f5a5b-bound-sa-token\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416515 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-registry-certificates\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416528 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e83877-7e88-409f-b4cf-088cbd8f5a5b-ca-trust-extracted\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416542 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e83877-7e88-409f-b4cf-088cbd8f5a5b-trusted-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416557 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-installation-pull-secrets\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.416784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.416571 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e83877-7e88-409f-b4cf-088cbd8f5a5b-image-registry-private-configuration\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:08.421203 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.421174 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:31:08.424378 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.424352 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c5b47cdd4-fljnx"] Jun 11 19:31:08.434830 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:08.434806 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb6798fc8-dj2m6"] Jun 11 19:31:08.436566 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:08.436542 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda52b9e1_09bc_4a6b_955a_59871c90a289.slice/crio-2217b96de05bb27302d44e4db856f3dc6849f182928fa1589fd36700aa7d8aaf WatchSource:0}: Error finding container 2217b96de05bb27302d44e4db856f3dc6849f182928fa1589fd36700aa7d8aaf: Status 404 returned error can't find the container with id 2217b96de05bb27302d44e4db856f3dc6849f182928fa1589fd36700aa7d8aaf Jun 11 19:31:09.240669 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.240630 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-688d6b77d6-bqmjk"] Jun 11 19:31:09.241068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.240974 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" Jun 11 19:31:09.241068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.240986 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" Jun 11 19:31:09.241068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.241032 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" containerName="registry" Jun 11 19:31:09.243788 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.243771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.246846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.246816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 19:31:09.246846 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.246839 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 19:31:09.247053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.246891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 19:31:09.247053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.246962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9kbjd8tarssq4\"" Jun 11 19:31:09.247053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.246984 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 19:31:09.247053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.247001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pf46d\"" Jun 11 19:31:09.253096 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.253073 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-688d6b77d6-bqmjk"] Jun 11 19:31:09.327606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-client-certs\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.327781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49e5e6a6-b0d7-449b-898a-ee8665d8617a-audit-log\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.327781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-tls\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.327954 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-client-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.327954 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.327954 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-metrics-server-audit-profiles\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.328114 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.327970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxch\" (UniqueName: \"kubernetes.io/projected/49e5e6a6-b0d7-449b-898a-ee8665d8617a-kube-api-access-5pxch\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.375265 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.375165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"2217b96de05bb27302d44e4db856f3dc6849f182928fa1589fd36700aa7d8aaf"} Jun 11 19:31:09.429380 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49e5e6a6-b0d7-449b-898a-ee8665d8617a-audit-log\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-tls\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-client-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429743 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-metrics-server-audit-profiles\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429743 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxch\" (UniqueName: \"kubernetes.io/projected/49e5e6a6-b0d7-449b-898a-ee8665d8617a-kube-api-access-5pxch\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429829 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-client-certs\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.429911 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.429863 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49e5e6a6-b0d7-449b-898a-ee8665d8617a-audit-log\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.430536 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.430512 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.430668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.430649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49e5e6a6-b0d7-449b-898a-ee8665d8617a-metrics-server-audit-profiles\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.432261 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.432244 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-client-ca-bundle\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.432777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.432756 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-client-certs\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.432777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.432768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49e5e6a6-b0d7-449b-898a-ee8665d8617a-secret-metrics-server-tls\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.437484 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.437460 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxch\" (UniqueName: \"kubernetes.io/projected/49e5e6a6-b0d7-449b-898a-ee8665d8617a-kube-api-access-5pxch\") pod \"metrics-server-688d6b77d6-bqmjk\" (UID: \"49e5e6a6-b0d7-449b-898a-ee8665d8617a\") " pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.554099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.554060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:09.709351 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.709136 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-688d6b77d6-bqmjk"] Jun 11 19:31:09.712291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.712267 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-59kcc"] Jun 11 19:31:09.714012 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.713981 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:09.716800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.716781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.719095 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.719068 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-n7547\"" Jun 11 19:31:09.719189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.719089 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 19:31:09.723578 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.723549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-59kcc"] Jun 11 19:31:09.770573 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.770529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:09.834196 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.834150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpqxk\" (UniqueName: \"kubernetes.io/projected/8d932368-4b73-4add-90ae-c91ebb33dc35-kube-api-access-mpqxk\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.834364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.834305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d932368-4b73-4add-90ae-c91ebb33dc35-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.905632 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.905537 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:09.945687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.935351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d932368-4b73-4add-90ae-c91ebb33dc35-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.945687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.935437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpqxk\" (UniqueName: \"kubernetes.io/projected/8d932368-4b73-4add-90ae-c91ebb33dc35-kube-api-access-mpqxk\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.945687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.940095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d932368-4b73-4add-90ae-c91ebb33dc35-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:09.946068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:09.946021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpqxk\" (UniqueName: \"kubernetes.io/projected/8d932368-4b73-4add-90ae-c91ebb33dc35-kube-api-access-mpqxk\") pod \"monitoring-plugin-589576dfc7-59kcc\" (UID: \"8d932368-4b73-4add-90ae-c91ebb33dc35\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:10.022098 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:10.022059 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e5e6a6_b0d7_449b_898a_ee8665d8617a.slice/crio-fb357ccfe55e398220d725eccff098ee04da87b646ad6a5e765d90c9b7bf6a94 WatchSource:0}: Error finding container fb357ccfe55e398220d725eccff098ee04da87b646ad6a5e765d90c9b7bf6a94: Status 404 returned error can't find the container with id fb357ccfe55e398220d725eccff098ee04da87b646ad6a5e765d90c9b7bf6a94 Jun 11 19:31:10.029005 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.028978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:10.189358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.189070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-59kcc"] Jun 11 19:31:10.192215 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:10.192180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d932368_4b73_4add_90ae_c91ebb33dc35.slice/crio-6809caa38cb32e060469b4f2eb161338be8359a710cc89233ad1f9faf39958eb WatchSource:0}: Error finding container 6809caa38cb32e060469b4f2eb161338be8359a710cc89233ad1f9faf39958eb: Status 404 returned error can't find the container with id 6809caa38cb32e060469b4f2eb161338be8359a710cc89233ad1f9faf39958eb Jun 11 19:31:10.238357 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.238322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:10.241400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.241330 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/149b0712-e3b7-4ee7-ad7a-a931c159ac4c-metrics-tls\") pod \"dns-default-5tjqf\" (UID: \"149b0712-e3b7-4ee7-ad7a-a931c159ac4c\") " pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:10.361851 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.361782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:10.362081 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.362066 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xk5k9\"" Jun 11 19:31:10.369896 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.369849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:10.382216 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.381708 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40e83877-7e88-409f-b4cf-088cbd8f5a5b" path="/var/lib/kubelet/pods/40e83877-7e88-409f-b4cf-088cbd8f5a5b/volumes" Jun 11 19:31:10.382216 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.382084 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:31:10.385156 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.385097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" event={"ID":"49e5e6a6-b0d7-449b-898a-ee8665d8617a","Type":"ContainerStarted","Data":"fb357ccfe55e398220d725eccff098ee04da87b646ad6a5e765d90c9b7bf6a94"} Jun 11 19:31:10.389495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.389305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"dc18782531bee0c3f0461e40ba75663ba8a7bbee7a5ba325a8b67525cbf518fc"} Jun 11 19:31:10.389495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.389387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"6fd7c47def238fa291a30fa1387ca04bc94deda58e57a6915cb401bdfb39879b"} Jun 11 19:31:10.389495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.389428 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"55dd6beea1c1551f00882fdc3727e53623009d5f2c7cfa5c5ca6f2a6b30ac6ec"} Jun 11 19:31:10.391965 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.391902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" event={"ID":"8d932368-4b73-4add-90ae-c91ebb33dc35","Type":"ContainerStarted","Data":"6809caa38cb32e060469b4f2eb161338be8359a710cc89233ad1f9faf39958eb"} Jun 11 19:31:10.406157 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.405912 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:31:10.411644 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.411603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.418812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.418772 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:31:10.431756 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.431708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:10.542161 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tjqf"] Jun 11 19:31:10.542556 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzmp\" (UniqueName: \"kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542890 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.542929 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.542917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.545154 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:10.545085 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149b0712_e3b7_4ee7_ad7a_a931c159ac4c.slice/crio-b71bcd6a9d400530c969a6b1a30e56c5a576e504c4ce139405b71fd72dacb602 WatchSource:0}: Error finding container b71bcd6a9d400530c969a6b1a30e56c5a576e504c4ce139405b71fd72dacb602: Status 404 returned error can't find the container with id b71bcd6a9d400530c969a6b1a30e56c5a576e504c4ce139405b71fd72dacb602 Jun 11 19:31:10.643524 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzmp\" (UniqueName: \"kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643857 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.643857 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.643745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.644526 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.644461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.644882 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.644780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.644882 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.644822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.645574 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.645545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.646800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.646754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.647215 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.647180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.652362 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.652343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzmp\" (UniqueName: \"kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp\") pod \"console-58988c5b87-7vlxt\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:10.664120 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.664049 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:10.664120 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.664129 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:10.670672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.670645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:10.740174 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:10.740031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:11.122217 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.122179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:11.397662 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.397567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tjqf" event={"ID":"149b0712-e3b7-4ee7-ad7a-a931c159ac4c","Type":"ContainerStarted","Data":"b71bcd6a9d400530c969a6b1a30e56c5a576e504c4ce139405b71fd72dacb602"} Jun 11 19:31:11.401486 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.401450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"e20ead03df5bc1925e275fee2f6353d3aceed4fd7babc862c1069747bbffd3f9"} Jun 11 19:31:11.401632 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.401535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"8a1b22caf2fc2cb571e61f5d3f673f49d66e204dd1ca2595072634c1e32b19a9"} Jun 11 19:31:11.405973 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.405944 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:11.962845 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:11.962792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:31:11.972518 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:31:11.968792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad85460_180e_476c_aa3f_b72f13e0973e.slice/crio-256b734d747d4bffaeed61580318138fe3026e58581db78ffe440926b9a19273 WatchSource:0}: Error finding container 256b734d747d4bffaeed61580318138fe3026e58581db78ffe440926b9a19273: Status 404 returned error can't find the container with id 256b734d747d4bffaeed61580318138fe3026e58581db78ffe440926b9a19273 Jun 11 19:31:12.207265 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.207105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:12.309692 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.309645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:12.406240 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.406173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:12.410388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.409334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58988c5b87-7vlxt" event={"ID":"5ad85460-180e-476c-aa3f-b72f13e0973e","Type":"ContainerStarted","Data":"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3"} Jun 11 19:31:12.410388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.409388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58988c5b87-7vlxt" event={"ID":"5ad85460-180e-476c-aa3f-b72f13e0973e","Type":"ContainerStarted","Data":"256b734d747d4bffaeed61580318138fe3026e58581db78ffe440926b9a19273"} Jun 11 19:31:12.412572 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.412479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" event={"ID":"49e5e6a6-b0d7-449b-898a-ee8665d8617a","Type":"ContainerStarted","Data":"d94da7ffb6d1bcd706885be6b292c0353aa50be387911d74fd266c064c6dfb53"} Jun 11 19:31:12.418525 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"f11d4ed37ad36481938cfb73ab7221a5fb626b992ac7d3a231d385d6cdba733f"} Jun 11 19:31:12.418676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"26b14ec39e4c1f80bf38439af5648effb38523a0cacba5fd39e0c17f0bcac848"} Jun 11 19:31:12.418676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"d3a6a01b252f0d529196600a814b21dcb4546c73c58ce3b1007d13c6fc652039"} Jun 11 19:31:12.418676 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418673 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:12.418834 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"b35fcaf56ab4fdf15c0b665ed40dd96cfa96918e001e0f3aa8ed3226e732a44e"} Jun 11 19:31:12.418834 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"d806fb7b8222da18a9ce2f1bcf01e6cd8c4b1f41e73ad200d695285079e1d200"} Jun 11 19:31:12.418834 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.418801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" event={"ID":"da52b9e1-09bc-4a6b-955a-59871c90a289","Type":"ContainerStarted","Data":"3e49c53892a94ff16c316b987044fe1309647174a157e8a4eb2745ebec5b8e7f"} Jun 11 19:31:12.424333 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.424290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f9b3d0f0-34e9-405f-aed6-4b9b886c2984","Type":"ContainerStarted","Data":"947b3ff811776c8d4ae41efdc01bd5d776ba231ff78c1683f54f9e8aae987a3f"} Jun 11 19:31:12.427811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.427746 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58988c5b87-7vlxt" podStartSLOduration=2.427725117 podStartE2EDuration="2.427725117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:12.427266857 +0000 UTC m=+290.479051931" watchObservedRunningTime="2026-06-11 19:31:12.427725117 +0000 UTC m=+290.479510169" Jun 11 19:31:12.479350 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.479269 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" podStartSLOduration=1.712079126 podStartE2EDuration="3.479245066s" totalImagesPullingTime="1.76716594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:12.448222432 +0000 UTC m=+290.500007494" watchObservedRunningTime="2026-06-11 19:31:12.479245066 +0000 UTC m=+290.531030129" Jun 11 19:31:12.480161 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.480121 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.450239349 podStartE2EDuration="7.480102232s" totalImagesPullingTime="4.011085265s" totalInitContainerRuntime="18.777618ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:12.478646387 +0000 UTC m=+290.530431449" watchObservedRunningTime="2026-06-11 19:31:12.480102232 +0000 UTC m=+290.531887292" Jun 11 19:31:12.505003 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:12.504943 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" podStartSLOduration=2.151139497 podStartE2EDuration="5.504920699s" totalImagesPullingTime="3.353781202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:12.502371732 +0000 UTC m=+290.554156830" watchObservedRunningTime="2026-06-11 19:31:12.504920699 +0000 UTC m=+290.556705764" Jun 11 19:31:14.434233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.434188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" event={"ID":"8d932368-4b73-4add-90ae-c91ebb33dc35","Type":"ContainerStarted","Data":"21830991fb1df96b3a87ebb75790abf21898f0dd77f43c37b62955b8a248253c"} Jun 11 19:31:14.434684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.434397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:14.436322 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.436286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tjqf" event={"ID":"149b0712-e3b7-4ee7-ad7a-a931c159ac4c","Type":"ContainerStarted","Data":"dd2fc65cffb7a2b87e8ceb849a0a90156c16d266bb702d9270348282333f67a7"} Jun 11 19:31:14.436453 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.436346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tjqf" event={"ID":"149b0712-e3b7-4ee7-ad7a-a931c159ac4c","Type":"ContainerStarted","Data":"60e6dafb536fdf795852c29edecd6d5314925d352817aa54bc2fd2970f0cc21e"} Jun 11 19:31:14.436453 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.436403 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:14.439480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.439462 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" Jun 11 19:31:14.449798 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.449742 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-59kcc" podStartSLOduration=2.241737448 podStartE2EDuration="5.44972783s" totalImagesPullingTime="3.207990382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:14.448763814 +0000 UTC m=+292.500548875" watchObservedRunningTime="2026-06-11 19:31:14.44972783 +0000 UTC m=+292.501512912" Jun 11 19:31:14.467130 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:14.467078 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5tjqf" podStartSLOduration=251.612280094 podStartE2EDuration="4m14.467058235s" totalImagesPullingTime="2.854778141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:14.465844264 +0000 UTC m=+292.517629341" watchObservedRunningTime="2026-06-11 19:31:14.467058235 +0000 UTC m=+292.518843296" Jun 11 19:31:18.435576 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:18.435543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cb6798fc8-dj2m6" Jun 11 19:31:19.144020 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:19.143983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:19.244319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:19.244282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:20.740621 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:20.740587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:20.741027 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:20.740651 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:20.745778 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:20.745755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:21.377835 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:21.377774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7tbdd" podUID="61acf913-396c-41e9-9073-e13bb414c6fa" Jun 11 19:31:21.469321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:21.469291 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:31:21.512976 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:21.512942 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:21.606470 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:21.606435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:21.707962 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:21.707877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:21.807921 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:21.807889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:22.212525 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:22.212489 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:22.313570 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:22.313536 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:22.339530 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:22.339501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:31:22.340646 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:22.340622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:31:22.351176 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:22.351149 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:31:24.442560 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:24.442532 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5tjqf" Jun 11 19:31:28.187790 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:28.187751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:28.241795 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:28.241757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:29.554948 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:29.554903 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:29.555329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:29.554972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:30.720490 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:30.720451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:30.818455 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:30.818416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.562197 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:33.562159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.616516 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:33.616481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.374297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:34.374255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:31:35.410458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.410423 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-645b66b55d-6qthp" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerName="console" containerID="cri-o://c84d4bf9d69b6cfb46abb85581dd089a1e8529fd7260fa29d11b967111c2587d" gracePeriod=15 Jun 11 19:31:35.525427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.525395 2581 generic.go:356] "Generic (PLEG): container finished" podID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerID="c84d4bf9d69b6cfb46abb85581dd089a1e8529fd7260fa29d11b967111c2587d" exitCode=0 Jun 11 19:31:35.525552 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.525442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645b66b55d-6qthp" event={"ID":"90819c49-a8b3-4d07-8ba6-73bf879ab6e6","Type":"ContainerDied","Data":"c84d4bf9d69b6cfb46abb85581dd089a1e8529fd7260fa29d11b967111c2587d"} Jun 11 19:31:35.652753 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.652726 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:31:35.687289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687254 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687280 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687336 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687361 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrrvf\" (UniqueName: \"kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert\") pod \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\" (UID: \"90819c49-a8b3-4d07-8ba6-73bf879ab6e6\") " Jun 11 19:31:35.687757 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687729 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:35.687833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687726 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config" (OuterVolumeSpecName: "console-config") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:35.687995 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.687974 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:35.689973 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.689942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf" (OuterVolumeSpecName: "kube-api-access-xrrvf") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "kube-api-access-xrrvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:35.690068 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.690042 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:35.690108 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.690083 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90819c49-a8b3-4d07-8ba6-73bf879ab6e6" (UID: "90819c49-a8b3-4d07-8ba6-73bf879ab6e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:35.788143 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788096 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-service-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:35.788143 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788134 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrrvf\" (UniqueName: \"kubernetes.io/projected/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-kube-api-access-xrrvf\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:35.788143 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788150 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-oauth-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:35.788458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788166 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-oauth-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:35.788458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788177 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:35.788458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:35.788189 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90819c49-a8b3-4d07-8ba6-73bf879ab6e6-console-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:36.530690 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:36.530656 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645b66b55d-6qthp" event={"ID":"90819c49-a8b3-4d07-8ba6-73bf879ab6e6","Type":"ContainerDied","Data":"37ab37328c85269b6f806341346a35b9e5ae29c9fa26ea538b25416e8409daf2"} Jun 11 19:31:36.530690 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:36.530682 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645b66b55d-6qthp" Jun 11 19:31:36.531189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:36.530726 2581 scope.go:117] "RemoveContainer" containerID="c84d4bf9d69b6cfb46abb85581dd089a1e8529fd7260fa29d11b967111c2587d" Jun 11 19:31:36.546595 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:36.546559 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:31:36.548024 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:36.547998 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-645b66b55d-6qthp"] Jun 11 19:31:38.378962 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:38.378921 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" path="/var/lib/kubelet/pods/90819c49-a8b3-4d07-8ba6-73bf879ab6e6/volumes" Jun 11 19:31:43.308114 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:43.308077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:43.407154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:43.407109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:45.717685 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:45.717644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:45.772071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:45.772036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:46.540438 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.540387 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-966b8ccc5-wlbrl" podUID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" containerName="console" containerID="cri-o://3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a" gracePeriod=15 Jun 11 19:31:46.780426 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.780400 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:46.902509 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902478 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.902649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902551 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.902649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.902649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.902795 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4z6l\" (UniqueName: \"kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.902795 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902701 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.903247 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.902910 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:46.903247 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903127 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca\") pod \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\" (UID: \"6fd27fb0-7229-4b50-bee9-7cc79945f6a5\") " Jun 11 19:31:46.903247 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903129 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:46.903247 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903150 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config" (OuterVolumeSpecName: "console-config") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:46.903651 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903624 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:31:46.903710 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903662 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:46.903710 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903685 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-oauth-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:46.903710 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.903700 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:46.913460 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.913431 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:46.927315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.927264 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:31:46.927315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:46.927294 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l" (OuterVolumeSpecName: "kube-api-access-b4z6l") pod "6fd27fb0-7229-4b50-bee9-7cc79945f6a5" (UID: "6fd27fb0-7229-4b50-bee9-7cc79945f6a5"). InnerVolumeSpecName "kube-api-access-b4z6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:47.005200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.005160 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:47.005200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.005192 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4z6l\" (UniqueName: \"kubernetes.io/projected/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-kube-api-access-b4z6l\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:47.005200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.005202 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-console-oauth-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:47.005200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.005211 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd27fb0-7229-4b50-bee9-7cc79945f6a5-service-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:31:47.580051 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.580015 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" containerID="3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a" exitCode=0 Jun 11 19:31:47.580236 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.580064 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-966b8ccc5-wlbrl" Jun 11 19:31:47.580236 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.580107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-966b8ccc5-wlbrl" event={"ID":"6fd27fb0-7229-4b50-bee9-7cc79945f6a5","Type":"ContainerDied","Data":"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a"} Jun 11 19:31:47.580236 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.580162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-966b8ccc5-wlbrl" event={"ID":"6fd27fb0-7229-4b50-bee9-7cc79945f6a5","Type":"ContainerDied","Data":"d7ab79605030f5c6407bcf772e41cad599c6f7c819feb62381952f6bb43375a4"} Jun 11 19:31:47.580236 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.580192 2581 scope.go:117] "RemoveContainer" containerID="3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a" Jun 11 19:31:47.581990 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.581964 2581 generic.go:356] "Generic (PLEG): container finished" podID="f640bdfa-03dd-463d-b644-3c5e206abe57" containerID="cd7e827ca3bffd15743a7e3202620116550535265622ccbcb384e34c135f1bc9" exitCode=0 Jun 11 19:31:47.582076 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.582046 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" event={"ID":"f640bdfa-03dd-463d-b644-3c5e206abe57","Type":"ContainerDied","Data":"cd7e827ca3bffd15743a7e3202620116550535265622ccbcb384e34c135f1bc9"} Jun 11 19:31:47.582427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.582409 2581 scope.go:117] "RemoveContainer" containerID="cd7e827ca3bffd15743a7e3202620116550535265622ccbcb384e34c135f1bc9" Jun 11 19:31:47.589282 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.589263 2581 scope.go:117] "RemoveContainer" containerID="3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a" Jun 11 19:31:47.591558 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:31:47.590984 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a\": container with ID starting with 3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a not found: ID does not exist" containerID="3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a" Jun 11 19:31:47.591558 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.591017 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a"} err="failed to get container status \"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a\": rpc error: code = NotFound desc = could not find container \"3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a\": container with ID starting with 3dd22dd8b75c146e41a303a60ca09ebd7fb506e217fe098dc431eac87a4c580a not found: ID does not exist" Jun 11 19:31:47.616644 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.616611 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:47.621425 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:47.621393 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-966b8ccc5-wlbrl"] Jun 11 19:31:48.379776 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:48.379738 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" path="/var/lib/kubelet/pods/6fd27fb0-7229-4b50-bee9-7cc79945f6a5/volumes" Jun 11 19:31:48.589393 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:48.589357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-m9bfs" event={"ID":"f640bdfa-03dd-463d-b644-3c5e206abe57","Type":"ContainerStarted","Data":"cd57b766819d61a24c47571cbfd5b91e86e7dc722f8bb6944d1f229659f9d59c"} Jun 11 19:31:49.560026 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:49.559998 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:49.563730 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:49.563707 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-688d6b77d6-bqmjk" Jun 11 19:31:51.601787 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:51.601753 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd123e75-a069-4b76-ad65-5dcb9ab4ede0" containerID="b1ec4b3996917f7bae93e5f1957100ff076ec15a4bdf90638dfeced6becc1b36" exitCode=0 Jun 11 19:31:51.602288 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:51.601832 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" event={"ID":"fd123e75-a069-4b76-ad65-5dcb9ab4ede0","Type":"ContainerDied","Data":"b1ec4b3996917f7bae93e5f1957100ff076ec15a4bdf90638dfeced6becc1b36"} Jun 11 19:31:51.602288 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:51.602271 2581 scope.go:117] "RemoveContainer" containerID="b1ec4b3996917f7bae93e5f1957100ff076ec15a4bdf90638dfeced6becc1b36" Jun 11 19:31:52.404557 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:52.404515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gb7cx_23ff1f2a-4c3b-4c93-a951-b8508c0be0b2/serve-healthcheck-canary/0.log" Jun 11 19:31:52.608066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:52.608032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-h7br9" event={"ID":"fd123e75-a069-4b76-ad65-5dcb9ab4ede0","Type":"ContainerStarted","Data":"fda88385808d75afee7625c2417223beb94dd15a2ffca62bce1461f934f5cec2"} Jun 11 19:31:53.837753 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:53.837697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.938783 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:53.938745 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.994337 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:31:53.994303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:21.468414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:21.468339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:21.520712 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:21.520676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:24.182792 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:24.182749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:24.383832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:24.383795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:29.274100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-97bf85f6f-q647c"] Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274413 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerName="console" Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274425 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerName="console" Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274461 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" containerName="console" Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274470 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" containerName="console" Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274528 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd27fb0-7229-4b50-bee9-7cc79945f6a5" containerName="console" Jun 11 19:32:29.274588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.274536 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90819c49-a8b3-4d07-8ba6-73bf879ab6e6" containerName="console" Jun 11 19:32:29.279411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.279386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.281908 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.281851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 19:32:29.282044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.281903 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 19:32:29.282044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.282001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 19:32:29.282044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.282018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 19:32:29.282156 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.282004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 19:32:29.282319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.282304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k8lqh\"" Jun 11 19:32:29.286996 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.286946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 19:32:29.289362 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.289336 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97bf85f6f-q647c"] Jun 11 19:32:29.397264 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-metrics-client-ca\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397264 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4v7\" (UniqueName: \"kubernetes.io/projected/73ec8532-ea0a-42f5-971e-35491684e660-kube-api-access-nl4v7\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-federate-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397480 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.397649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.397496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-serving-certs-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498511 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-federate-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498674 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498674 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498674 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-serving-certs-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-metrics-client-ca\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4v7\" (UniqueName: \"kubernetes.io/projected/73ec8532-ea0a-42f5-971e-35491684e660-kube-api-access-nl4v7\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.498951 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.498906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.499664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.499638 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-metrics-client-ca\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.499817 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.499702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.499966 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.499912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ec8532-ea0a-42f5-971e-35491684e660-serving-certs-ca-bundle\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.501513 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.501490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-federate-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.501603 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.501514 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.501923 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.501903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-telemeter-client-tls\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.501998 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.501933 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73ec8532-ea0a-42f5-971e-35491684e660-secret-telemeter-client\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.506516 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.506495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4v7\" (UniqueName: \"kubernetes.io/projected/73ec8532-ea0a-42f5-971e-35491684e660-kube-api-access-nl4v7\") pod \"telemeter-client-97bf85f6f-q647c\" (UID: \"73ec8532-ea0a-42f5-971e-35491684e660\") " pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.590717 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.590682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" Jun 11 19:32:29.731463 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.731408 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97bf85f6f-q647c"] Jun 11 19:32:29.734287 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:32:29.734252 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ec8532_ea0a_42f5_971e_35491684e660.slice/crio-82bc39dd0917688f461fcb116ab6957f84f36afe880ea00f24f6fe6dbca94c53 WatchSource:0}: Error finding container 82bc39dd0917688f461fcb116ab6957f84f36afe880ea00f24f6fe6dbca94c53: Status 404 returned error can't find the container with id 82bc39dd0917688f461fcb116ab6957f84f36afe880ea00f24f6fe6dbca94c53 Jun 11 19:32:29.736300 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.736279 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:32:29.758721 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:29.758687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" event={"ID":"73ec8532-ea0a-42f5-971e-35491684e660","Type":"ContainerStarted","Data":"82bc39dd0917688f461fcb116ab6957f84f36afe880ea00f24f6fe6dbca94c53"} Jun 11 19:32:32.775583 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:32.775549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" event={"ID":"73ec8532-ea0a-42f5-971e-35491684e660","Type":"ContainerStarted","Data":"1bdcb402a29b1f5f1f05410d8d973a493ec095add724c05cb1d62d228c6d9503"} Jun 11 19:32:32.776015 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:32.775605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" event={"ID":"73ec8532-ea0a-42f5-971e-35491684e660","Type":"ContainerStarted","Data":"851c2ba827487e3124e83ad898822efb102d103242d42a81d5f546f399c49991"} Jun 11 19:32:32.776015 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:32.775624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" event={"ID":"73ec8532-ea0a-42f5-971e-35491684e660","Type":"ContainerStarted","Data":"fddb3bbfc55d0618dc9fcfff23ddba989516afbcdc98b5e84fff8c3f5404b1d7"} Jun 11 19:32:32.799590 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:32.799525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-97bf85f6f-q647c" podStartSLOduration=1.445268714 podStartE2EDuration="3.799505461s" totalImagesPullingTime="2.354236747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:32.797491788 +0000 UTC m=+370.849276848" watchObservedRunningTime="2026-06-11 19:32:32.799505461 +0000 UTC m=+370.851290522" Jun 11 19:32:33.498329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.498289 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:32:33.501860 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.501834 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.513155 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.513130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:32:33.553541 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.553499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:33.606768 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.606717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:33.643644 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbm7j\" (UniqueName: \"kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.643843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.643843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.643843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.643843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.643843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.644135 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.643910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbm7j\" (UniqueName: \"kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.744913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.744799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.745611 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.745575 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.745720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.745575 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.745720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.745579 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.746018 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.745993 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.747515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.747493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.747619 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.747598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.752203 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.752153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbm7j\" (UniqueName: \"kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j\") pod \"console-88bfb5675-x7lcg\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.810766 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.810729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:33.950543 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:33.950508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:32:33.953638 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:32:33.953606 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cde636_3c46_45c9_966b_31c5ce1eaf9f.slice/crio-b5e0069ddc3a608779ffa52590bba2fd0fe56716d52b9651703c63f92d9e49e0 WatchSource:0}: Error finding container b5e0069ddc3a608779ffa52590bba2fd0fe56716d52b9651703c63f92d9e49e0: Status 404 returned error can't find the container with id b5e0069ddc3a608779ffa52590bba2fd0fe56716d52b9651703c63f92d9e49e0 Jun 11 19:32:34.784560 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:34.784521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bfb5675-x7lcg" event={"ID":"63cde636-3c46-45c9-966b-31c5ce1eaf9f","Type":"ContainerStarted","Data":"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da"} Jun 11 19:32:34.784720 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:34.784582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bfb5675-x7lcg" event={"ID":"63cde636-3c46-45c9-966b-31c5ce1eaf9f","Type":"ContainerStarted","Data":"b5e0069ddc3a608779ffa52590bba2fd0fe56716d52b9651703c63f92d9e49e0"} Jun 11 19:32:34.802902 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:34.802704 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88bfb5675-x7lcg" podStartSLOduration=1.8026813480000001 podStartE2EDuration="1.802681348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:34.802245021 +0000 UTC m=+372.854030082" watchObservedRunningTime="2026-06-11 19:32:34.802681348 +0000 UTC m=+372.854466410" Jun 11 19:32:35.360565 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.360524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:32:35.363034 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.363013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61acf913-396c-41e9-9073-e13bb414c6fa-metrics-certs\") pod \"network-metrics-daemon-7tbdd\" (UID: \"61acf913-396c-41e9-9073-e13bb414c6fa\") " pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:32:35.577672 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.577637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdvp2\"" Jun 11 19:32:35.585820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.585791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tbdd" Jun 11 19:32:35.722962 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.722930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tbdd"] Jun 11 19:32:35.725524 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:32:35.725488 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61acf913_396c_41e9_9073_e13bb414c6fa.slice/crio-19819a924964d0ce2c28ef6d768580b6b17eaf849be154dbd274b830f00fd93a WatchSource:0}: Error finding container 19819a924964d0ce2c28ef6d768580b6b17eaf849be154dbd274b830f00fd93a: Status 404 returned error can't find the container with id 19819a924964d0ce2c28ef6d768580b6b17eaf849be154dbd274b830f00fd93a Jun 11 19:32:35.789710 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:35.789672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tbdd" event={"ID":"61acf913-396c-41e9-9073-e13bb414c6fa","Type":"ContainerStarted","Data":"19819a924964d0ce2c28ef6d768580b6b17eaf849be154dbd274b830f00fd93a"} Jun 11 19:32:37.801492 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:37.801452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tbdd" event={"ID":"61acf913-396c-41e9-9073-e13bb414c6fa","Type":"ContainerStarted","Data":"c542768d47fd685ecc8fd66838452a52509380068c41cd607eb9cec18cf06a75"} Jun 11 19:32:37.801917 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:37.801547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tbdd" event={"ID":"61acf913-396c-41e9-9073-e13bb414c6fa","Type":"ContainerStarted","Data":"1df0a1aa8d2c194004e327223710e9c6dff13cb39400f09c2ede2bae723efb75"} Jun 11 19:32:37.818707 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:37.818648 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7tbdd" podStartSLOduration=374.684655819 podStartE2EDuration="6m15.81862883s" totalImagesPullingTime="1.133973011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:37.816528749 +0000 UTC m=+375.868313809" watchObservedRunningTime="2026-06-11 19:32:37.81862883 +0000 UTC m=+375.870413934" Jun 11 19:32:37.905885 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:37.905843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:37.962961 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:37.962930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:39.429855 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:39.429811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:39.485166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:39.485130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:40.950302 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:40.950263 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:32:40.985692 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:40.985659 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:32:40.989009 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:40.988974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:40.999001 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:40.998970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:32:41.003326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk9t\" (UniqueName: \"kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003491 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003528 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003595 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.003595 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.003584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.104777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.104738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.104804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk9t\" (UniqueName: \"kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.104857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.104975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105250 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105250 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105583 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105557 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105762 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105847 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105759 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.105972 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.105799 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.107608 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.107583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.107700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.107606 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.113642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.113614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk9t\" (UniqueName: \"kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t\") pod \"console-5dbc585bf8-rds4j\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.299369 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.299277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:41.457276 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.457183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:32:41.459535 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:32:41.459505 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95be9cf9_4055_4409_b52d_43a6891040b8.slice/crio-82d641bb9fd376004bda1df3127702cb25b64e5032368986def0400868e23583 WatchSource:0}: Error finding container 82d641bb9fd376004bda1df3127702cb25b64e5032368986def0400868e23583: Status 404 returned error can't find the container with id 82d641bb9fd376004bda1df3127702cb25b64e5032368986def0400868e23583 Jun 11 19:32:41.819642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.819604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbc585bf8-rds4j" event={"ID":"95be9cf9-4055-4409-b52d-43a6891040b8","Type":"ContainerStarted","Data":"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c"} Jun 11 19:32:41.819813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.819659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbc585bf8-rds4j" event={"ID":"95be9cf9-4055-4409-b52d-43a6891040b8","Type":"ContainerStarted","Data":"82d641bb9fd376004bda1df3127702cb25b64e5032368986def0400868e23583"} Jun 11 19:32:41.837883 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:41.837797 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dbc585bf8-rds4j" podStartSLOduration=1.837775135 podStartE2EDuration="1.837775135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:41.837057688 +0000 UTC m=+379.888842752" watchObservedRunningTime="2026-06-11 19:32:41.837775135 +0000 UTC m=+379.889560197" Jun 11 19:32:43.811505 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:43.811462 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:32:51.299474 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.299418 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:51.299859 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.299516 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:51.304194 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.304169 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:51.422915 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.422844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:51.477051 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.477011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:51.863848 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.863818 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:32:51.912205 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:51.912167 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:32:52.007105 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:52.007048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:52.116365 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:52.116279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:52.192070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:52.192032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:58.061315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:32:58.061274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:00.720033 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:00.719992 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:00.819586 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:00.819548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:05.970712 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:05.970641 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-88bfb5675-x7lcg" podUID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" containerName="console" containerID="cri-o://593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da" gracePeriod=15 Jun 11 19:33:06.210102 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.210071 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:33:06.336099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336111 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336156 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336179 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336209 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336253 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbm7j\" (UniqueName: \"kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336310 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config\") pod \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\" (UID: \"63cde636-3c46-45c9-966b-31c5ce1eaf9f\") " Jun 11 19:33:06.336682 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336442 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:06.336682 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336576 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-oauth-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.336799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336685 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:06.336799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:06.336799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.336743 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config" (OuterVolumeSpecName: "console-config") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:06.338622 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.338591 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:06.339000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.338984 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:06.339062 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.338990 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j" (OuterVolumeSpecName: "kube-api-access-fbm7j") pod "63cde636-3c46-45c9-966b-31c5ce1eaf9f" (UID: "63cde636-3c46-45c9-966b-31c5ce1eaf9f"). InnerVolumeSpecName "kube-api-access-fbm7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:06.437227 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437188 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.437227 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437223 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.437227 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437234 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-service-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.437458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437242 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbm7j\" (UniqueName: \"kubernetes.io/projected/63cde636-3c46-45c9-966b-31c5ce1eaf9f-kube-api-access-fbm7j\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.437458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437252 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.437458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.437260 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63cde636-3c46-45c9-966b-31c5ce1eaf9f-console-oauth-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:06.930265 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.930229 2581 generic.go:356] "Generic (PLEG): container finished" podID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" containerID="593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da" exitCode=0 Jun 11 19:33:06.930434 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.930274 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bfb5675-x7lcg" Jun 11 19:33:06.930434 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.930317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bfb5675-x7lcg" event={"ID":"63cde636-3c46-45c9-966b-31c5ce1eaf9f","Type":"ContainerDied","Data":"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da"} Jun 11 19:33:06.930434 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.930369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bfb5675-x7lcg" event={"ID":"63cde636-3c46-45c9-966b-31c5ce1eaf9f","Type":"ContainerDied","Data":"b5e0069ddc3a608779ffa52590bba2fd0fe56716d52b9651703c63f92d9e49e0"} Jun 11 19:33:06.930434 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.930392 2581 scope.go:117] "RemoveContainer" containerID="593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da" Jun 11 19:33:06.939029 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.939012 2581 scope.go:117] "RemoveContainer" containerID="593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da" Jun 11 19:33:06.939324 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:33:06.939304 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da\": container with ID starting with 593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da not found: ID does not exist" containerID="593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da" Jun 11 19:33:06.939387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.939337 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da"} err="failed to get container status \"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da\": rpc error: code = NotFound desc = could not find container \"593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da\": container with ID starting with 593774cda7f1a33ba609589f27f6663eebf571bee5fd75ea4200ac83fed222da not found: ID does not exist" Jun 11 19:33:06.947207 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.947175 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:33:06.948651 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:06.948631 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88bfb5675-x7lcg"] Jun 11 19:33:08.379614 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:08.379575 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" path="/var/lib/kubelet/pods/63cde636-3c46-45c9-966b-31c5ce1eaf9f/volumes" Jun 11 19:33:16.933668 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:16.933588 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58988c5b87-7vlxt" podUID="5ad85460-180e-476c-aa3f-b72f13e0973e" containerName="console" containerID="cri-o://2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3" gracePeriod=15 Jun 11 19:33:17.175817 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.175783 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:33:17.334481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334381 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334426 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334748 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334529 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkzmp\" (UniqueName: \"kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334748 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334576 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334748 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.334748 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334649 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert\") pod \"5ad85460-180e-476c-aa3f-b72f13e0973e\" (UID: \"5ad85460-180e-476c-aa3f-b72f13e0973e\") " Jun 11 19:33:17.335007 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.334966 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:17.335077 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.335045 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:17.335136 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.335085 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:17.335191 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.335127 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config" (OuterVolumeSpecName: "console-config") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:17.337089 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.337066 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:17.337202 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.337082 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:17.337202 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.337101 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp" (OuterVolumeSpecName: "kube-api-access-lkzmp") pod "5ad85460-180e-476c-aa3f-b72f13e0973e" (UID: "5ad85460-180e-476c-aa3f-b72f13e0973e"). InnerVolumeSpecName "kube-api-access-lkzmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:17.436270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436232 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436266 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-service-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436275 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-oauth-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436284 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkzmp\" (UniqueName: \"kubernetes.io/projected/5ad85460-180e-476c-aa3f-b72f13e0973e-kube-api-access-lkzmp\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436295 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-console-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436303 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ad85460-180e-476c-aa3f-b72f13e0973e-oauth-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.436495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.436311 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ad85460-180e-476c-aa3f-b72f13e0973e-console-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.980611 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.980574 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ad85460-180e-476c-aa3f-b72f13e0973e" containerID="2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3" exitCode=0 Jun 11 19:33:17.981106 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.980621 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58988c5b87-7vlxt" Jun 11 19:33:17.981106 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.980665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58988c5b87-7vlxt" event={"ID":"5ad85460-180e-476c-aa3f-b72f13e0973e","Type":"ContainerDied","Data":"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3"} Jun 11 19:33:17.981106 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.980731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58988c5b87-7vlxt" event={"ID":"5ad85460-180e-476c-aa3f-b72f13e0973e","Type":"ContainerDied","Data":"256b734d747d4bffaeed61580318138fe3026e58581db78ffe440926b9a19273"} Jun 11 19:33:17.981106 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.980763 2581 scope.go:117] "RemoveContainer" containerID="2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3" Jun 11 19:33:17.989696 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.989680 2581 scope.go:117] "RemoveContainer" containerID="2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3" Jun 11 19:33:17.989991 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:33:17.989975 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3\": container with ID starting with 2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3 not found: ID does not exist" containerID="2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3" Jun 11 19:33:17.990044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:17.989999 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3"} err="failed to get container status \"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3\": rpc error: code = NotFound desc = could not find container \"2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3\": container with ID starting with 2c1a6193df9e61caef0cf7fb84e323a469684451f8f74b98f89a19de08a24fb3 not found: ID does not exist" Jun 11 19:33:18.000838 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:18.000807 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:33:18.004516 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:18.004491 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58988c5b87-7vlxt"] Jun 11 19:33:18.379507 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:18.379473 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad85460-180e-476c-aa3f-b72f13e0973e" path="/var/lib/kubelet/pods/5ad85460-180e-476c-aa3f-b72f13e0973e/volumes" Jun 11 19:33:21.504860 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:21.504824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:21.594606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:21.594570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:22.097853 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.097809 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f"] Jun 11 19:33:22.098175 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098160 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad85460-180e-476c-aa3f-b72f13e0973e" containerName="console" Jun 11 19:33:22.098223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098176 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad85460-180e-476c-aa3f-b72f13e0973e" containerName="console" Jun 11 19:33:22.098223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098186 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" containerName="console" Jun 11 19:33:22.098223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098191 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" containerName="console" Jun 11 19:33:22.098332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098258 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ad85460-180e-476c-aa3f-b72f13e0973e" containerName="console" Jun 11 19:33:22.098332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.098266 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63cde636-3c46-45c9-966b-31c5ce1eaf9f" containerName="console" Jun 11 19:33:22.103292 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.103267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.105967 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.105942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:33:22.106092 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.105944 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:33:22.106745 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.106727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:33:22.113709 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.113681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f"] Jun 11 19:33:22.277118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.277075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.277313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.277150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.277313 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.277200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnvx\" (UniqueName: \"kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.377951 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.377909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.378144 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.377989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnvx\" (UniqueName: \"kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.378144 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.378073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.378302 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.378279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.378358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.378348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.386681 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.386655 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:33:22.397990 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.397965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:33:22.408698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.408660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnvx\" (UniqueName: \"kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.415536 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.415515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:33:22.424232 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.424210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:22.566353 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.566318 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f"] Jun 11 19:33:22.569010 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:33:22.568981 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff8a438_60ce_4760_ac58_c50749c41d1e.slice/crio-258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67 WatchSource:0}: Error finding container 258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67: Status 404 returned error can't find the container with id 258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67 Jun 11 19:33:22.569802 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.569749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:22.627396 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:22.627303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:23.004227 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:23.004140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" event={"ID":"6ff8a438-60ce-4760-ac58-c50749c41d1e","Type":"ContainerStarted","Data":"258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67"} Jun 11 19:33:33.052337 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:33.052293 2581 generic.go:356] "Generic (PLEG): container finished" podID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerID="c3e3bc83f9ca48717fc3c7d4996a5ae3ff1efeaeb5207a6b000637c21ac89b9c" exitCode=0 Jun 11 19:33:33.052337 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:33.052336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" event={"ID":"6ff8a438-60ce-4760-ac58-c50749c41d1e","Type":"ContainerDied","Data":"c3e3bc83f9ca48717fc3c7d4996a5ae3ff1efeaeb5207a6b000637c21ac89b9c"} Jun 11 19:33:36.067415 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:36.067376 2581 generic.go:356] "Generic (PLEG): container finished" podID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerID="1fbc299adfd253722ee4ccef3d018185e4d654277fd6a9a4f237b29403fcf99e" exitCode=0 Jun 11 19:33:36.067810 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:36.067464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" event={"ID":"6ff8a438-60ce-4760-ac58-c50749c41d1e","Type":"ContainerDied","Data":"1fbc299adfd253722ee4ccef3d018185e4d654277fd6a9a4f237b29403fcf99e"} Jun 11 19:33:44.106808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:44.106769 2581 generic.go:356] "Generic (PLEG): container finished" podID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerID="93cd028d7388616db09f0f7db0224d5d4c9c9696a5965391d284011a705eb383" exitCode=0 Jun 11 19:33:44.107289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:44.106854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" event={"ID":"6ff8a438-60ce-4760-ac58-c50749c41d1e","Type":"ContainerDied","Data":"93cd028d7388616db09f0f7db0224d5d4c9c9696a5965391d284011a705eb383"} Jun 11 19:33:45.241134 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.241110 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:45.384436 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.384350 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnvx\" (UniqueName: \"kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx\") pod \"6ff8a438-60ce-4760-ac58-c50749c41d1e\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " Jun 11 19:33:45.384587 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.384443 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util\") pod \"6ff8a438-60ce-4760-ac58-c50749c41d1e\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " Jun 11 19:33:45.384587 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.384523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle\") pod \"6ff8a438-60ce-4760-ac58-c50749c41d1e\" (UID: \"6ff8a438-60ce-4760-ac58-c50749c41d1e\") " Jun 11 19:33:45.385200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.385167 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle" (OuterVolumeSpecName: "bundle") pod "6ff8a438-60ce-4760-ac58-c50749c41d1e" (UID: "6ff8a438-60ce-4760-ac58-c50749c41d1e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:45.386771 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.386735 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx" (OuterVolumeSpecName: "kube-api-access-sxnvx") pod "6ff8a438-60ce-4760-ac58-c50749c41d1e" (UID: "6ff8a438-60ce-4760-ac58-c50749c41d1e"). InnerVolumeSpecName "kube-api-access-sxnvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:45.388506 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.388486 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util" (OuterVolumeSpecName: "util") pod "6ff8a438-60ce-4760-ac58-c50749c41d1e" (UID: "6ff8a438-60ce-4760-ac58-c50749c41d1e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:45.486098 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.486040 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:45.486098 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.486091 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnvx\" (UniqueName: \"kubernetes.io/projected/6ff8a438-60ce-4760-ac58-c50749c41d1e-kube-api-access-sxnvx\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:45.486098 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:45.486104 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ff8a438-60ce-4760-ac58-c50749c41d1e-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.117736 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:46.117694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" event={"ID":"6ff8a438-60ce-4760-ac58-c50749c41d1e","Type":"ContainerDied","Data":"258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67"} Jun 11 19:33:46.117736 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:46.117720 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddxs8f" Jun 11 19:33:46.117976 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:46.117749 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="258153815ff8de390962c2ac77f30689a7511a78e33c9532b321803a87f3ab67" Jun 11 19:33:48.118507 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:48.118420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:48.945811 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:48.945768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:50.058656 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.058614 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr"] Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.058985 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="extract" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.058997 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="extract" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.059023 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="pull" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.059029 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="pull" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.059038 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="util" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.059043 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="util" Jun 11 19:33:50.059086 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.059089 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff8a438-60ce-4760-ac58-c50749c41d1e" containerName="extract" Jun 11 19:33:50.101656 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.101622 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr"] Jun 11 19:33:50.101806 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.101746 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.104162 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.104137 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 19:33:50.104310 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.104173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zqh55\"" Jun 11 19:33:50.104419 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.104403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:33:50.228731 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.228688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98dff830-9e24-4084-92b3-c0c83e61ab45-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.228985 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.228827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75cml\" (UniqueName: \"kubernetes.io/projected/98dff830-9e24-4084-92b3-c0c83e61ab45-kube-api-access-75cml\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.329326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.329231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75cml\" (UniqueName: \"kubernetes.io/projected/98dff830-9e24-4084-92b3-c0c83e61ab45-kube-api-access-75cml\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.329326 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.329281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98dff830-9e24-4084-92b3-c0c83e61ab45-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.329628 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.329610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98dff830-9e24-4084-92b3-c0c83e61ab45-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.342378 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.342350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75cml\" (UniqueName: \"kubernetes.io/projected/98dff830-9e24-4084-92b3-c0c83e61ab45-kube-api-access-75cml\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pjxnr\" (UID: \"98dff830-9e24-4084-92b3-c0c83e61ab45\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.410937 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.410896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" Jun 11 19:33:50.586948 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:50.586907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr"] Jun 11 19:33:50.593052 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:33:50.593024 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dff830_9e24_4084_92b3_c0c83e61ab45.slice/crio-72a8a449fbc895234ca7b3366a716c04141c7401a178c0f03ae62bfa5ac4a624 WatchSource:0}: Error finding container 72a8a449fbc895234ca7b3366a716c04141c7401a178c0f03ae62bfa5ac4a624: Status 404 returned error can't find the container with id 72a8a449fbc895234ca7b3366a716c04141c7401a178c0f03ae62bfa5ac4a624 Jun 11 19:33:51.139606 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:51.139567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" event={"ID":"98dff830-9e24-4084-92b3-c0c83e61ab45","Type":"ContainerStarted","Data":"72a8a449fbc895234ca7b3366a716c04141c7401a178c0f03ae62bfa5ac4a624"} Jun 11 19:33:51.734916 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:51.734830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:51.840913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:51.840831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:53.150151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:53.150100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" event={"ID":"98dff830-9e24-4084-92b3-c0c83e61ab45","Type":"ContainerStarted","Data":"821ed4c9df5dbb6bd454b4555a70355dfae24aab1b95a9b486799854814d4dbf"} Jun 11 19:33:53.177919 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:53.177846 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pjxnr" podStartSLOduration=1.012380407 podStartE2EDuration="3.177828952s" totalImagesPullingTime="2.165448545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:33:53.17560149 +0000 UTC m=+451.227386543" watchObservedRunningTime="2026-06-11 19:33:53.177828952 +0000 UTC m=+451.229614013" Jun 11 19:33:53.535964 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:53.535862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:53.633082 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:53.633046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:54.155189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.155131 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9"] Jun 11 19:33:54.162263 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.162231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.164556 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.164534 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:33:54.166143 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.165904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:33:54.166143 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.165924 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:33:54.168732 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.168700 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9"] Jun 11 19:33:54.264233 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.264195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.264414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.264254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.264414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.264306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spzc\" (UniqueName: \"kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.365436 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.365389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.365636 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.365462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.365636 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.365491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spzc\" (UniqueName: \"kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.365806 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.365782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.365898 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.365822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.384100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.384069 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spzc\" (UniqueName: \"kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.473345 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.473255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:33:54.610308 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:54.610277 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9"] Jun 11 19:33:54.612380 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:33:54.612346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb2700c_1e2a_426a_9a03_93df551de66d.slice/crio-8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577 WatchSource:0}: Error finding container 8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577: Status 404 returned error can't find the container with id 8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577 Jun 11 19:33:55.163466 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:55.163427 2581 generic.go:356] "Generic (PLEG): container finished" podID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerID="d991482318f03666aac3ca7811ff45b6199ceb9d5ec0e6deaeb96c91aa37f551" exitCode=0 Jun 11 19:33:55.163891 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:55.163511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" event={"ID":"3cb2700c-1e2a-426a-9a03-93df551de66d","Type":"ContainerDied","Data":"d991482318f03666aac3ca7811ff45b6199ceb9d5ec0e6deaeb96c91aa37f551"} Jun 11 19:33:55.163891 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:55.163556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" event={"ID":"3cb2700c-1e2a-426a-9a03-93df551de66d","Type":"ContainerStarted","Data":"8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577"} Jun 11 19:33:57.027053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.027014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:57.432005 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.431967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:57.517053 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.517019 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wfb42"] Jun 11 19:33:57.519206 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.519188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.521604 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.521582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 19:33:57.522367 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.522338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hglts\"" Jun 11 19:33:57.522479 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.522338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 19:33:57.529505 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.529441 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wfb42"] Jun 11 19:33:57.699195 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.699160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xqkm\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-kube-api-access-5xqkm\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.699341 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.699206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.800329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.800234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xqkm\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-kube-api-access-5xqkm\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.800329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.800284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.808731 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.808699 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.808925 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.808838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xqkm\" (UniqueName: \"kubernetes.io/projected/9e0565b2-6e5a-4d5f-9e40-8cd524741add-kube-api-access-5xqkm\") pod \"cert-manager-cainjector-5d99449ffd-wfb42\" (UID: \"9e0565b2-6e5a-4d5f-9e40-8cd524741add\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.845646 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.845600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" Jun 11 19:33:57.983044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:57.983007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wfb42"] Jun 11 19:33:57.986145 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:33:57.986109 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e0565b2_6e5a_4d5f_9e40_8cd524741add.slice/crio-b8d78b704077d9791edd05a5b937ec83e5fb45cb6f5a7b8778f5ad654fbbdc56 WatchSource:0}: Error finding container b8d78b704077d9791edd05a5b937ec83e5fb45cb6f5a7b8778f5ad654fbbdc56: Status 404 returned error can't find the container with id b8d78b704077d9791edd05a5b937ec83e5fb45cb6f5a7b8778f5ad654fbbdc56 Jun 11 19:33:58.182544 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:58.182512 2581 generic.go:356] "Generic (PLEG): container finished" podID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerID="05a9b61f20c55944cc0f0a70d60ab51351095251dfdd0ae1f459642daf68e503" exitCode=0 Jun 11 19:33:58.183015 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:58.182602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" event={"ID":"3cb2700c-1e2a-426a-9a03-93df551de66d","Type":"ContainerDied","Data":"05a9b61f20c55944cc0f0a70d60ab51351095251dfdd0ae1f459642daf68e503"} Jun 11 19:33:58.189946 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:58.189900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" event={"ID":"9e0565b2-6e5a-4d5f-9e40-8cd524741add","Type":"ContainerStarted","Data":"b8d78b704077d9791edd05a5b937ec83e5fb45cb6f5a7b8778f5ad654fbbdc56"} Jun 11 19:33:58.523522 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:58.523404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:58.624405 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:58.624364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:59.198682 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:59.198629 2581 generic.go:356] "Generic (PLEG): container finished" podID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerID="54b5e3c48f6a152b133d11bc7b8c8df06b65d5779927e20b06783f92c0307744" exitCode=0 Jun 11 19:33:59.199151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:33:59.198693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" event={"ID":"3cb2700c-1e2a-426a-9a03-93df551de66d","Type":"ContainerDied","Data":"54b5e3c48f6a152b133d11bc7b8c8df06b65d5779927e20b06783f92c0307744"} Jun 11 19:34:00.469251 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.469189 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:34:00.624808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.624771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle\") pod \"3cb2700c-1e2a-426a-9a03-93df551de66d\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " Jun 11 19:34:00.624808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.624817 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util\") pod \"3cb2700c-1e2a-426a-9a03-93df551de66d\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " Jun 11 19:34:00.625071 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.624851 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4spzc\" (UniqueName: \"kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc\") pod \"3cb2700c-1e2a-426a-9a03-93df551de66d\" (UID: \"3cb2700c-1e2a-426a-9a03-93df551de66d\") " Jun 11 19:34:00.625342 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.625312 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle" (OuterVolumeSpecName: "bundle") pod "3cb2700c-1e2a-426a-9a03-93df551de66d" (UID: "3cb2700c-1e2a-426a-9a03-93df551de66d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:00.627251 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.627229 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc" (OuterVolumeSpecName: "kube-api-access-4spzc") pod "3cb2700c-1e2a-426a-9a03-93df551de66d" (UID: "3cb2700c-1e2a-426a-9a03-93df551de66d"). InnerVolumeSpecName "kube-api-access-4spzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:00.631067 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.631038 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util" (OuterVolumeSpecName: "util") pod "3cb2700c-1e2a-426a-9a03-93df551de66d" (UID: "3cb2700c-1e2a-426a-9a03-93df551de66d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:00.726514 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.726422 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:00.726514 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.726458 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cb2700c-1e2a-426a-9a03-93df551de66d-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:00.726514 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:00.726468 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4spzc\" (UniqueName: \"kubernetes.io/projected/3cb2700c-1e2a-426a-9a03-93df551de66d-kube-api-access-4spzc\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:01.211462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.211427 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" Jun 11 19:34:01.211462 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.211452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4c5z9" event={"ID":"3cb2700c-1e2a-426a-9a03-93df551de66d","Type":"ContainerDied","Data":"8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577"} Jun 11 19:34:01.211679 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.211501 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e58082bf25e854a40c7820881ce967b828a306f54e4b8f374fbf53d03651577" Jun 11 19:34:01.213081 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.213055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" event={"ID":"9e0565b2-6e5a-4d5f-9e40-8cd524741add","Type":"ContainerStarted","Data":"84ab64852f5895ea4f1c716e7b09a3ce43f7f17fa3a6e5e52c28db98eb10eacf"} Jun 11 19:34:01.229194 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.229147 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wfb42" podStartSLOduration=1.730869453 podStartE2EDuration="4.22913086s" totalImagesPullingTime="2.498261407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:01.228565909 +0000 UTC m=+459.280350972" watchObservedRunningTime="2026-06-11 19:34:01.22913086 +0000 UTC m=+459.280915921" Jun 11 19:34:01.611238 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611151 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-schnr"] Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="util" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611502 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="util" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611513 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="pull" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611518 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="pull" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611527 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="extract" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611533 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="extract" Jun 11 19:34:01.611698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.611590 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb2700c-1e2a-426a-9a03-93df551de66d" containerName="extract" Jun 11 19:34:01.613943 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.613922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.616041 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.616019 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6gnkw\"" Jun 11 19:34:01.623831 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.623805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-schnr"] Jun 11 19:34:01.734945 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.734900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.735122 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.735021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8844b\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-kube-api-access-8844b\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.835712 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.835655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8844b\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-kube-api-access-8844b\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.835955 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.835745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.844365 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.844337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.844531 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.844509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8844b\" (UniqueName: \"kubernetes.io/projected/7fcd906d-becd-481a-ac46-0116d626c2a6-kube-api-access-8844b\") pod \"cert-manager-webhook-7dc76cbb94-schnr\" (UID: \"7fcd906d-becd-481a-ac46-0116d626c2a6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:01.923430 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:01.923334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:02.061412 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:02.061386 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-schnr"] Jun 11 19:34:02.063592 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:02.063560 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fcd906d_becd_481a_ac46_0116d626c2a6.slice/crio-cc4e2327b7b978fa2845237814da8f1a9d40c88de31b3364feeef0c0c8827c4b WatchSource:0}: Error finding container cc4e2327b7b978fa2845237814da8f1a9d40c88de31b3364feeef0c0c8827c4b: Status 404 returned error can't find the container with id cc4e2327b7b978fa2845237814da8f1a9d40c88de31b3364feeef0c0c8827c4b Jun 11 19:34:02.220006 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:02.219897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" event={"ID":"7fcd906d-becd-481a-ac46-0116d626c2a6","Type":"ContainerStarted","Data":"eea9acd3bb6a48695c454310a498df3416f7e831bd261c7cce72498ad23166ea"} Jun 11 19:34:02.220006 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:02.219952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" event={"ID":"7fcd906d-becd-481a-ac46-0116d626c2a6","Type":"ContainerStarted","Data":"cc4e2327b7b978fa2845237814da8f1a9d40c88de31b3364feeef0c0c8827c4b"} Jun 11 19:34:02.220198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:02.220080 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:02.238812 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:02.238755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" podStartSLOduration=1.238736925 podStartE2EDuration="1.238736925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:02.237164158 +0000 UTC m=+460.288949219" watchObservedRunningTime="2026-06-11 19:34:02.238736925 +0000 UTC m=+460.290521986" Jun 11 19:34:04.624599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:04.624560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:04.928832 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:04.928738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:05.029446 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:05.029381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:06.967605 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.967565 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd"] Jun 11 19:34:06.970240 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.970218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:06.973221 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.973194 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 19:34:06.974118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.974088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qxdss\"" Jun 11 19:34:06.974255 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.974088 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:34:06.980448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.980421 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd"] Jun 11 19:34:06.982608 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.982576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74xj\" (UniqueName: \"kubernetes.io/projected/ecce15bf-5a65-4e11-a8af-792b326f55b3-kube-api-access-k74xj\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:06.982739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:06.982654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecce15bf-5a65-4e11-a8af-792b326f55b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.083777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.083729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecce15bf-5a65-4e11-a8af-792b326f55b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.083967 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.083837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k74xj\" (UniqueName: \"kubernetes.io/projected/ecce15bf-5a65-4e11-a8af-792b326f55b3-kube-api-access-k74xj\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.084150 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.084132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecce15bf-5a65-4e11-a8af-792b326f55b3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.092537 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.092506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74xj\" (UniqueName: \"kubernetes.io/projected/ecce15bf-5a65-4e11-a8af-792b326f55b3-kube-api-access-k74xj\") pod \"openshift-lws-operator-fd8ccff4c-94fcd\" (UID: \"ecce15bf-5a65-4e11-a8af-792b326f55b3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.283187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.283099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" Jun 11 19:34:07.434786 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:07.434751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd"] Jun 11 19:34:07.439213 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:07.439178 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecce15bf_5a65_4e11_a8af_792b326f55b3.slice/crio-b69ccb73a3bbb7529c1db5cbd056f736bf979ea64e3bc36837e17268c13814e7 WatchSource:0}: Error finding container b69ccb73a3bbb7529c1db5cbd056f736bf979ea64e3bc36837e17268c13814e7: Status 404 returned error can't find the container with id b69ccb73a3bbb7529c1db5cbd056f736bf979ea64e3bc36837e17268c13814e7 Jun 11 19:34:08.228047 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:08.228015 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-schnr" Jun 11 19:34:08.257490 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:08.257409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" event={"ID":"ecce15bf-5a65-4e11-a8af-792b326f55b3","Type":"ContainerStarted","Data":"b69ccb73a3bbb7529c1db5cbd056f736bf979ea64e3bc36837e17268c13814e7"} Jun 11 19:34:10.270410 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:10.270373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" event={"ID":"ecce15bf-5a65-4e11-a8af-792b326f55b3","Type":"ContainerStarted","Data":"8c479d40c37a95d80fc03786b3299dfc47a83737335eca013eaf6f8d03755e3a"} Jun 11 19:34:10.286278 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:10.286208 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-94fcd" podStartSLOduration=2.513635737 podStartE2EDuration="4.28618988s" totalImagesPullingTime="1.772554143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:10.285646828 +0000 UTC m=+468.337431888" watchObservedRunningTime="2026-06-11 19:34:10.28618988 +0000 UTC m=+468.337974946" Jun 11 19:34:10.975446 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:10.975415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:11.076384 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:11.076356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:13.162100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:13.162060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:14.802616 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.802581 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh"] Jun 11 19:34:14.823098 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.823063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh"] Jun 11 19:34:14.823271 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.823198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.825971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.825949 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:34:14.826728 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.826709 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:34:14.826822 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.826719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:34:14.860289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.860254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.860465 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.860327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smm9\" (UniqueName: \"kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.860465 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.860382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.960826 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.960790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smm9\" (UniqueName: \"kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.961021 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.960850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.961021 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.960917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.966496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.961599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.966496 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.961631 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:14.969518 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:14.969494 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smm9\" (UniqueName: \"kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:15.133882 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:15.133840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:15.306016 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:15.305933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh"] Jun 11 19:34:15.308417 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:15.308385 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7517666b_613b_4e4f_94d9_40abe86b6299.slice/crio-861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6 WatchSource:0}: Error finding container 861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6: Status 404 returned error can't find the container with id 861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6 Jun 11 19:34:16.300722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:16.300623 2581 generic.go:356] "Generic (PLEG): container finished" podID="7517666b-613b-4e4f-94d9-40abe86b6299" containerID="b5f731230d758514a94920994bbd02ff6b4c154d2daa3d57bacbdd99cb56249e" exitCode=0 Jun 11 19:34:16.300722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:16.300709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" event={"ID":"7517666b-613b-4e4f-94d9-40abe86b6299","Type":"ContainerDied","Data":"b5f731230d758514a94920994bbd02ff6b4c154d2daa3d57bacbdd99cb56249e"} Jun 11 19:34:16.301205 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:16.300754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" event={"ID":"7517666b-613b-4e4f-94d9-40abe86b6299","Type":"ContainerStarted","Data":"861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6"} Jun 11 19:34:17.307635 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:17.307535 2581 generic.go:356] "Generic (PLEG): container finished" podID="7517666b-613b-4e4f-94d9-40abe86b6299" containerID="3eacda2a6402a1e192ed96470eb06226091eebdd69a7443299748d0886a16b75" exitCode=0 Jun 11 19:34:17.307635 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:17.307605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" event={"ID":"7517666b-613b-4e4f-94d9-40abe86b6299","Type":"ContainerDied","Data":"3eacda2a6402a1e192ed96470eb06226091eebdd69a7443299748d0886a16b75"} Jun 11 19:34:18.315212 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:18.315174 2581 generic.go:356] "Generic (PLEG): container finished" podID="7517666b-613b-4e4f-94d9-40abe86b6299" containerID="5f19aa5ba8b0000849312343a00e7364ddb465db8e15c08b2ae7c0519e9c1346" exitCode=0 Jun 11 19:34:18.315666 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:18.315251 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" event={"ID":"7517666b-613b-4e4f-94d9-40abe86b6299","Type":"ContainerDied","Data":"5f19aa5ba8b0000849312343a00e7364ddb465db8e15c08b2ae7c0519e9c1346"} Jun 11 19:34:19.451446 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.451414 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:19.501160 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.501124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util\") pod \"7517666b-613b-4e4f-94d9-40abe86b6299\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " Jun 11 19:34:19.501348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.501171 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smm9\" (UniqueName: \"kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9\") pod \"7517666b-613b-4e4f-94d9-40abe86b6299\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " Jun 11 19:34:19.501348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.501193 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle\") pod \"7517666b-613b-4e4f-94d9-40abe86b6299\" (UID: \"7517666b-613b-4e4f-94d9-40abe86b6299\") " Jun 11 19:34:19.501911 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.501854 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle" (OuterVolumeSpecName: "bundle") pod "7517666b-613b-4e4f-94d9-40abe86b6299" (UID: "7517666b-613b-4e4f-94d9-40abe86b6299"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:19.503495 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.503455 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9" (OuterVolumeSpecName: "kube-api-access-4smm9") pod "7517666b-613b-4e4f-94d9-40abe86b6299" (UID: "7517666b-613b-4e4f-94d9-40abe86b6299"). InnerVolumeSpecName "kube-api-access-4smm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:19.506344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.506318 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util" (OuterVolumeSpecName: "util") pod "7517666b-613b-4e4f-94d9-40abe86b6299" (UID: "7517666b-613b-4e4f-94d9-40abe86b6299"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:19.602375 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.602317 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smm9\" (UniqueName: \"kubernetes.io/projected/7517666b-613b-4e4f-94d9-40abe86b6299-kube-api-access-4smm9\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:19.602375 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.602376 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:19.602375 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:19.602386 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7517666b-613b-4e4f-94d9-40abe86b6299-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:20.327406 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:20.327377 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" Jun 11 19:34:20.327591 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:20.327370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnlmgh" event={"ID":"7517666b-613b-4e4f-94d9-40abe86b6299","Type":"ContainerDied","Data":"861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6"} Jun 11 19:34:20.327591 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:20.327514 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="861e71291cc6426cc9d752051b710df11ce923f45ffd8f151dbebf44f052fff6" Jun 11 19:34:20.387855 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:20.387810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:20.439238 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:20.439202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.476235 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.476179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.576295 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576252 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc"] Jun 11 19:34:25.576703 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576684 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="extract" Jun 11 19:34:25.576819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576706 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="extract" Jun 11 19:34:25.576819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576722 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="util" Jun 11 19:34:25.576819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576729 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="util" Jun 11 19:34:25.576819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576739 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="pull" Jun 11 19:34:25.576819 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576747 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="pull" Jun 11 19:34:25.577087 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.576891 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7517666b-613b-4e4f-94d9-40abe86b6299" containerName="extract" Jun 11 19:34:25.579886 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.579851 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.581205 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.581167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.582367 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.582345 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 19:34:25.583552 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.583530 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 19:34:25.583642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.583532 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 19:34:25.583642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.583561 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g589s\"" Jun 11 19:34:25.590539 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.590516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc"] Jun 11 19:34:25.660354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.660308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-manager-config\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.660354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.660359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-metrics-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.660563 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.660457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpk5\" (UniqueName: \"kubernetes.io/projected/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-kube-api-access-8fpk5\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.660563 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.660546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.747182 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.747093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.761464 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.761422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-manager-config\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.761658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.761475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-metrics-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.761658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.761513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpk5\" (UniqueName: \"kubernetes.io/projected/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-kube-api-access-8fpk5\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.761658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.761610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.762311 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.762278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-manager-config\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.764399 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.764376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.764538 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.764519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-metrics-cert\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.773384 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.773358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpk5\" (UniqueName: \"kubernetes.io/projected/826c1a96-3fb0-47ba-9da5-34a5d52c1f47-kube-api-access-8fpk5\") pod \"lws-controller-manager-fb68f47b6-n9hbc\" (UID: \"826c1a96-3fb0-47ba-9da5-34a5d52c1f47\") " pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:25.864371 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.864333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.890340 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:25.890303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:26.050630 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.050605 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc"] Jun 11 19:34:26.052127 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:26.052092 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826c1a96_3fb0_47ba_9da5_34a5d52c1f47.slice/crio-0557c3a61f3f30d4d20d9157201d515829eb2c1ed8f8f2ba80e16335db92bf90 WatchSource:0}: Error finding container 0557c3a61f3f30d4d20d9157201d515829eb2c1ed8f8f2ba80e16335db92bf90: Status 404 returned error can't find the container with id 0557c3a61f3f30d4d20d9157201d515829eb2c1ed8f8f2ba80e16335db92bf90 Jun 11 19:34:26.348139 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.348110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.361332 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.361295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" event={"ID":"826c1a96-3fb0-47ba-9da5-34a5d52c1f47","Type":"ContainerStarted","Data":"0557c3a61f3f30d4d20d9157201d515829eb2c1ed8f8f2ba80e16335db92bf90"} Jun 11 19:34:26.588563 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.588521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.692515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.692430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.752764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.752731 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr"] Jun 11 19:34:26.755684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.755653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.759826 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.759781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 19:34:26.759980 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.759840 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 19:34:26.760111 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.760090 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 19:34:26.762282 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.762236 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 19:34:26.762555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.762533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pxtxj\"" Jun 11 19:34:26.777991 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.777951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr"] Jun 11 19:34:26.859843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.859805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.873251 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.873213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.873429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.873267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.873429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.873318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhvh\" (UniqueName: \"kubernetes.io/projected/d222da78-d017-4ad6-8d11-86659c584a79-kube-api-access-hfhvh\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.873429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.873360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.873429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.873416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.954355 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.954269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.974787 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.974747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.975000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.974808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.975000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.974836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhvh\" (UniqueName: \"kubernetes.io/projected/d222da78-d017-4ad6-8d11-86659c584a79-kube-api-access-hfhvh\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.975000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.974895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.975000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.974956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.975454 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.975422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.978296 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.978263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d222da78-d017-4ad6-8d11-86659c584a79-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.978417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.978313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.978417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.978380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d222da78-d017-4ad6-8d11-86659c584a79-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:26.984263 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:26.984234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhvh\" (UniqueName: \"kubernetes.io/projected/d222da78-d017-4ad6-8d11-86659c584a79-kube-api-access-hfhvh\") pod \"opendatahub-operator-controller-manager-6c94886895-qzrcr\" (UID: \"d222da78-d017-4ad6-8d11-86659c584a79\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:27.056188 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:27.056111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:27.079260 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:27.079220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:27.157967 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:27.157937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:27.250971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:27.250881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:27.256961 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:27.256919 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr"] Jun 11 19:34:27.524009 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:27.523932 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd222da78_d017_4ad6_8d11_86659c584a79.slice/crio-aa63c7e4d7afc5faf942d07816b05ba9064b4c8aae72501bbf5708f7115c9637 WatchSource:0}: Error finding container aa63c7e4d7afc5faf942d07816b05ba9064b4c8aae72501bbf5708f7115c9637: Status 404 returned error can't find the container with id aa63c7e4d7afc5faf942d07816b05ba9064b4c8aae72501bbf5708f7115c9637 Jun 11 19:34:28.382850 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:28.382815 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:28.383285 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:28.382887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" event={"ID":"826c1a96-3fb0-47ba-9da5-34a5d52c1f47","Type":"ContainerStarted","Data":"7f9c494285a80586e51b4fd5d7cc2aba38054ed28f270140225996e6ceee9db2"} Jun 11 19:34:28.383285 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:28.382910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" event={"ID":"d222da78-d017-4ad6-8d11-86659c584a79","Type":"ContainerStarted","Data":"aa63c7e4d7afc5faf942d07816b05ba9064b4c8aae72501bbf5708f7115c9637"} Jun 11 19:34:28.395923 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:28.395836 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" podStartSLOduration=1.892928758 podStartE2EDuration="3.395811267s" totalImagesPullingTime="1.502882509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:28.394416549 +0000 UTC m=+486.446201610" watchObservedRunningTime="2026-06-11 19:34:28.395811267 +0000 UTC m=+486.447596328" Jun 11 19:34:28.936900 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:28.936764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:29.036633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:29.036528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:30.395566 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:30.395511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" event={"ID":"d222da78-d017-4ad6-8d11-86659c584a79","Type":"ContainerStarted","Data":"72ccf35a37399964271a0d833c18debe9405b35c4444c0920c1a9ffd1601bc8e"} Jun 11 19:34:32.407533 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:32.407499 2581 generic.go:356] "Generic (PLEG): container finished" podID="d222da78-d017-4ad6-8d11-86659c584a79" containerID="72ccf35a37399964271a0d833c18debe9405b35c4444c0920c1a9ffd1601bc8e" exitCode=0 Jun 11 19:34:32.407922 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:32.407573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" event={"ID":"d222da78-d017-4ad6-8d11-86659c584a79","Type":"ContainerDied","Data":"72ccf35a37399964271a0d833c18debe9405b35c4444c0920c1a9ffd1601bc8e"} Jun 11 19:34:33.415297 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:33.415259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" event={"ID":"d222da78-d017-4ad6-8d11-86659c584a79","Type":"ContainerStarted","Data":"c33d952aa69997372de4bc72ba376d20729fb8038178ded95fc4ee72964f8243"} Jun 11 19:34:33.415649 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:33.415518 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:33.437792 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:33.437733 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" podStartSLOduration=3.151019897 podStartE2EDuration="7.437714824s" totalImagesPullingTime="3.247069256s" totalInitContainerRuntime="1.039625671s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:33.434803795 +0000 UTC m=+491.486588857" watchObservedRunningTime="2026-06-11 19:34:33.437714824 +0000 UTC m=+491.489499955" Jun 11 19:34:37.301743 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:37.301705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:37.392788 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:37.392748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:39.388570 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:39.388538 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fb68f47b6-n9hbc" Jun 11 19:34:41.840417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:41.840376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:41.953336 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:41.953296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:42.286764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:42.286676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:42.342342 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:42.342306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:44.423460 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:44.423430 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-qzrcr" Jun 11 19:34:45.929895 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:45.929825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:46.042913 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:46.042842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.169479 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.169445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.271506 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.271477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.372547 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.372509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.484315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.484202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.728779 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.728739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:48.918152 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:48.918105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:49.310557 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.310472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:49.406165 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.406132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:49.506860 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.506825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:49.629244 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.629207 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n"] Jun 11 19:34:49.633561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.633537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.636223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.636198 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 19:34:49.636674 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.636340 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 19:34:49.636889 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.636352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kk2bf\"" Jun 11 19:34:49.636889 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.636435 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 19:34:49.637214 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.637195 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 19:34:49.644078 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.644055 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n"] Jun 11 19:34:49.685851 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.685807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d75e6-cf31-4886-85e6-27dc629404ea-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.686099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.685896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m5l8\" (UniqueName: \"kubernetes.io/projected/2b2d75e6-cf31-4886-85e6-27dc629404ea-kube-api-access-9m5l8\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.686099 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.685927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75e6-cf31-4886-85e6-27dc629404ea-tmp\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.779436 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.779404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:49.786640 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.786617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75e6-cf31-4886-85e6-27dc629404ea-tmp\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.786750 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.786678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d75e6-cf31-4886-85e6-27dc629404ea-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.786750 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.786720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m5l8\" (UniqueName: \"kubernetes.io/projected/2b2d75e6-cf31-4886-85e6-27dc629404ea-kube-api-access-9m5l8\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.789088 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.789060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b2d75e6-cf31-4886-85e6-27dc629404ea-tmp\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.789330 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.789313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b2d75e6-cf31-4886-85e6-27dc629404ea-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.794365 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.794342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m5l8\" (UniqueName: \"kubernetes.io/projected/2b2d75e6-cf31-4886-85e6-27dc629404ea-kube-api-access-9m5l8\") pod \"kube-auth-proxy-5b4bf4958f-2hb5n\" (UID: \"2b2d75e6-cf31-4886-85e6-27dc629404ea\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:49.945709 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:49.945618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" Jun 11 19:34:50.086242 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:50.086211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n"] Jun 11 19:34:50.088454 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:50.088422 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2d75e6_cf31_4886_85e6_27dc629404ea.slice/crio-0f661c6378c5d5ceaf55bdcf7ce69bc557842975c2ae72ffbf9274f921432ba4 WatchSource:0}: Error finding container 0f661c6378c5d5ceaf55bdcf7ce69bc557842975c2ae72ffbf9274f921432ba4: Status 404 returned error can't find the container with id 0f661c6378c5d5ceaf55bdcf7ce69bc557842975c2ae72ffbf9274f921432ba4 Jun 11 19:34:50.507261 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:50.507224 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" event={"ID":"2b2d75e6-cf31-4886-85e6-27dc629404ea","Type":"ContainerStarted","Data":"0f661c6378c5d5ceaf55bdcf7ce69bc557842975c2ae72ffbf9274f921432ba4"} Jun 11 19:34:51.265528 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.265493 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv"] Jun 11 19:34:51.270301 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.270268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.272529 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.272504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:34:51.273246 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.273221 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:34:51.273246 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.273241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:34:51.288571 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.284055 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv"] Jun 11 19:34:51.300230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.300195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.300408 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.300253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.300408 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.300284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.401388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.401346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.401582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.401401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.401582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.401421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.402065 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.402038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.402203 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.402038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.409979 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.409949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:51.593355 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:51.593313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:52.373147 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:52.373112 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv"] Jun 11 19:34:52.376693 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:34:52.376660 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ee2101_b223_4636_8f8b_348ca8b267d5.slice/crio-f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b WatchSource:0}: Error finding container f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b: Status 404 returned error can't find the container with id f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b Jun 11 19:34:52.519576 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:52.519539 2581 generic.go:356] "Generic (PLEG): container finished" podID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerID="3fc49009aabdd0df0508f651c3f62be72ae4051eb1cd0b4f6e2d6a0f5e2bbd8d" exitCode=0 Jun 11 19:34:52.519729 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:52.519612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" event={"ID":"11ee2101-b223-4636-8f8b-348ca8b267d5","Type":"ContainerDied","Data":"3fc49009aabdd0df0508f651c3f62be72ae4051eb1cd0b4f6e2d6a0f5e2bbd8d"} Jun 11 19:34:52.519729 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:52.519667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" event={"ID":"11ee2101-b223-4636-8f8b-348ca8b267d5","Type":"ContainerStarted","Data":"f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b"} Jun 11 19:34:54.531939 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:54.531897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" event={"ID":"2b2d75e6-cf31-4886-85e6-27dc629404ea","Type":"ContainerStarted","Data":"55b887c15c2b5d51d541a11f33ca797f145e3f608d932fcbaf2da5773f9c25e6"} Jun 11 19:34:54.533888 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:54.533843 2581 generic.go:356] "Generic (PLEG): container finished" podID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerID="caeffc00856cc8459ff3e19ed872e7250b86bf894c81161ae018f0abf8c9f470" exitCode=0 Jun 11 19:34:54.534029 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:54.533902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" event={"ID":"11ee2101-b223-4636-8f8b-348ca8b267d5","Type":"ContainerDied","Data":"caeffc00856cc8459ff3e19ed872e7250b86bf894c81161ae018f0abf8c9f470"} Jun 11 19:34:54.568697 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:54.568647 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-2hb5n" podStartSLOduration=2.156326987 podStartE2EDuration="5.568631397s" totalImagesPullingTime="3.41230441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:54.54682458 +0000 UTC m=+512.598609645" watchObservedRunningTime="2026-06-11 19:34:54.568631397 +0000 UTC m=+512.620416511" Jun 11 19:34:55.545379 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:55.545335 2581 generic.go:356] "Generic (PLEG): container finished" podID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerID="71b484369ee9593c78b58b731d6c2e138fd7debe28fc9c88d10a5ff8e74d0964" exitCode=0 Jun 11 19:34:55.546902 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:55.546850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" event={"ID":"11ee2101-b223-4636-8f8b-348ca8b267d5","Type":"ContainerDied","Data":"71b484369ee9593c78b58b731d6c2e138fd7debe28fc9c88d10a5ff8e74d0964"} Jun 11 19:34:56.689238 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.689179 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:56.750698 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.750659 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle\") pod \"11ee2101-b223-4636-8f8b-348ca8b267d5\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " Jun 11 19:34:56.750887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.750722 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75\") pod \"11ee2101-b223-4636-8f8b-348ca8b267d5\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " Jun 11 19:34:56.750887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.750800 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util\") pod \"11ee2101-b223-4636-8f8b-348ca8b267d5\" (UID: \"11ee2101-b223-4636-8f8b-348ca8b267d5\") " Jun 11 19:34:56.751783 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.751704 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle" (OuterVolumeSpecName: "bundle") pod "11ee2101-b223-4636-8f8b-348ca8b267d5" (UID: "11ee2101-b223-4636-8f8b-348ca8b267d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:56.753518 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.753488 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75" (OuterVolumeSpecName: "kube-api-access-7ql75") pod "11ee2101-b223-4636-8f8b-348ca8b267d5" (UID: "11ee2101-b223-4636-8f8b-348ca8b267d5"). InnerVolumeSpecName "kube-api-access-7ql75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:56.756333 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.756298 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util" (OuterVolumeSpecName: "util") pod "11ee2101-b223-4636-8f8b-348ca8b267d5" (UID: "11ee2101-b223-4636-8f8b-348ca8b267d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:56.852032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.851999 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:56.852032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.852031 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11ee2101-b223-4636-8f8b-348ca8b267d5-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:56.852032 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:56.852041 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ql75\" (UniqueName: \"kubernetes.io/projected/11ee2101-b223-4636-8f8b-348ca8b267d5-kube-api-access-7ql75\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:34:57.561567 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:57.561517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" event={"ID":"11ee2101-b223-4636-8f8b-348ca8b267d5","Type":"ContainerDied","Data":"f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b"} Jun 11 19:34:57.561780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:57.561590 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f20047f63e11efee25d2e6841cd2ca2d8af5d41a4455bff5d43dae313490776b" Jun 11 19:34:57.561780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:57.561536 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0648fgv" Jun 11 19:34:58.952670 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:58.952633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:59.055982 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:59.055945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:59.290338 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:59.290218 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:59.451061 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:34:59.451024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:00.298896 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:00.298843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:00.389431 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:00.389397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:00.901760 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:00.901720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:01.009319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:01.009284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:02.774957 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:02.774905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:02.870851 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:02.870812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:04.009631 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.009583 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt"] Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010165 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="util" Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010187 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="util" Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010209 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="pull" Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010219 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="pull" Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010244 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="extract" Jun 11 19:35:04.010347 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010253 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="extract" Jun 11 19:35:04.010797 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.010352 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11ee2101-b223-4636-8f8b-348ca8b267d5" containerName="extract" Jun 11 19:35:04.015566 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.015541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.021695 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:35:04.021655 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" is forbidden: User \"system:node:ip-10-0-130-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-130-228.ec2.internal' and this object" podUID="be28d31a-b588-4df0-b391-dc54b5376773" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.021917 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.021814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:35:04.024189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.024152 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:35:04.024310 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.024289 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:35:04.039522 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.039479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt"] Jun 11 19:35:04.120787 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.120734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.121028 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.120844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tc2\" (UniqueName: \"kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.121028 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.120937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.199452 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.199402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:04.222301 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.222261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tc2\" (UniqueName: \"kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.222500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.222321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.222554 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.222492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.222735 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.222716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.222900 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.222842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.238156 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.238117 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tc2\" (UniqueName: \"kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.327611 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.327518 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:04.534814 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.534783 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt"] Jun 11 19:35:04.536366 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:35:04.536334 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe28d31a_b588_4df0_b391_dc54b5376773.slice/crio-9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131 WatchSource:0}: Error finding container 9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131: Status 404 returned error can't find the container with id 9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131 Jun 11 19:35:04.600730 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.600697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" event={"ID":"be28d31a-b588-4df0-b391-dc54b5376773","Type":"ContainerStarted","Data":"9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131"} Jun 11 19:35:04.638403 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:04.638367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:05.166200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:05.166166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:05.290459 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:05.290408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:05.607721 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:05.607680 2581 generic.go:356] "Generic (PLEG): container finished" podID="be28d31a-b588-4df0-b391-dc54b5376773" containerID="11ff77284b6d938934793f78c89c7bdc6e28c0afaeb5d37207b6be04fc6590a3" exitCode=0 Jun 11 19:35:05.607940 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:05.607753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" event={"ID":"be28d31a-b588-4df0-b391-dc54b5376773","Type":"ContainerDied","Data":"11ff77284b6d938934793f78c89c7bdc6e28c0afaeb5d37207b6be04fc6590a3"} Jun 11 19:35:06.839799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:06.839756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:07.619763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:07.619730 2581 generic.go:356] "Generic (PLEG): container finished" podID="be28d31a-b588-4df0-b391-dc54b5376773" containerID="106c43927db43516ea101f8ba9fa4d6ce61bc0b86f2c27e4054ffbf41ed0dd7e" exitCode=0 Jun 11 19:35:07.620006 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:07.619825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" event={"ID":"be28d31a-b588-4df0-b391-dc54b5376773","Type":"ContainerDied","Data":"106c43927db43516ea101f8ba9fa4d6ce61bc0b86f2c27e4054ffbf41ed0dd7e"} Jun 11 19:35:08.627770 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:08.627735 2581 generic.go:356] "Generic (PLEG): container finished" podID="be28d31a-b588-4df0-b391-dc54b5376773" containerID="e9faf8cc12f3aedcdd5ff418bf23718e8407897b65c95a9ecbedab10979ca95b" exitCode=0 Jun 11 19:35:08.628252 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:08.627824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" event={"ID":"be28d31a-b588-4df0-b391-dc54b5376773","Type":"ContainerDied","Data":"e9faf8cc12f3aedcdd5ff418bf23718e8407897b65c95a9ecbedab10979ca95b"} Jun 11 19:35:09.772117 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.772093 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:09.874923 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.874861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle\") pod \"be28d31a-b588-4df0-b391-dc54b5376773\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " Jun 11 19:35:09.875116 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.874993 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util\") pod \"be28d31a-b588-4df0-b391-dc54b5376773\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " Jun 11 19:35:09.875116 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.875038 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8tc2\" (UniqueName: \"kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2\") pod \"be28d31a-b588-4df0-b391-dc54b5376773\" (UID: \"be28d31a-b588-4df0-b391-dc54b5376773\") " Jun 11 19:35:09.875901 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.875849 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle" (OuterVolumeSpecName: "bundle") pod "be28d31a-b588-4df0-b391-dc54b5376773" (UID: "be28d31a-b588-4df0-b391-dc54b5376773"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:35:09.877266 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.877242 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2" (OuterVolumeSpecName: "kube-api-access-f8tc2") pod "be28d31a-b588-4df0-b391-dc54b5376773" (UID: "be28d31a-b588-4df0-b391-dc54b5376773"). InnerVolumeSpecName "kube-api-access-f8tc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:35:09.879626 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.879601 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util" (OuterVolumeSpecName: "util") pod "be28d31a-b588-4df0-b391-dc54b5376773" (UID: "be28d31a-b588-4df0-b391-dc54b5376773"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:35:09.975777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.975690 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:35:09.975777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.975719 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8tc2\" (UniqueName: \"kubernetes.io/projected/be28d31a-b588-4df0-b391-dc54b5376773-kube-api-access-f8tc2\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:35:09.975777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:09.975730 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be28d31a-b588-4df0-b391-dc54b5376773-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:35:10.643364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:10.643281 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" Jun 11 19:35:10.643364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:10.643316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajrmqt" event={"ID":"be28d31a-b588-4df0-b391-dc54b5376773","Type":"ContainerDied","Data":"9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131"} Jun 11 19:35:10.643551 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:10.643371 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9957eb7f3ca741872b7dfa65de3bba6f73dfd9dd6e2458792ffae81b49fa8131" Jun 11 19:35:15.043535 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:15.043496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:15.607223 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:15.607178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:15.708264 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:15.708232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:20.426290 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:20.426257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:20.485315 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:20.485281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:20.953107 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:20.953069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:24.342535 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:24.342485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:24.443658 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:24.443615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:24.643808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:24.643715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:24.751482 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:24.751440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:24.852446 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:24.852416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:25.380561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:25.380520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:27.827457 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:27.827424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:47.561096 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:47.561056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:47.647789 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:47.647748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:47.715715 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:47.715672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:48.449110 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:48.449076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:48.652579 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:35:48.652546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:03.469883 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.469832 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q"] Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470223 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="util" Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470235 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="util" Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470244 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="pull" Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470251 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="pull" Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470257 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="extract" Jun 11 19:36:03.470329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470263 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="extract" Jun 11 19:36:03.470652 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.470352 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="be28d31a-b588-4df0-b391-dc54b5376773" containerName="extract" Jun 11 19:36:03.474127 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.474108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.476675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.476648 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 19:36:03.476839 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.476747 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bqd9q\"" Jun 11 19:36:03.476839 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.476819 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 19:36:03.482638 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.482611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q"] Jun 11 19:36:03.568137 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.568088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4kww\" (UniqueName: \"kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.568318 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.568154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.568318 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.568196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.669173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.669131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4kww\" (UniqueName: \"kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.669173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.669178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.669408 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.669204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.669645 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.669620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.669684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.669630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.677494 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.677457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4kww\" (UniqueName: \"kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.784852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.784811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:03.963675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:03.963648 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q"] Jun 11 19:36:03.965844 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:36:03.965821 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72876fdc_6930_4238_9e4f_6b3a27c64760.slice/crio-1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021 WatchSource:0}: Error finding container 1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021: Status 404 returned error can't find the container with id 1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021 Jun 11 19:36:04.269318 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.269229 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb"] Jun 11 19:36:04.273070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.273052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.281000 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.280971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb"] Jun 11 19:36:04.376050 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.376010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.376240 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.376086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9md\" (UniqueName: \"kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.376240 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.376137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.477282 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.477235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9md\" (UniqueName: \"kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.477741 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.477297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.477741 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.477360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.477905 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.477753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.477905 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.477812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.486276 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.486254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9md\" (UniqueName: \"kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.583386 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.583289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:04.674600 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.674566 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf"] Jun 11 19:36:04.678833 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.678807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.687717 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.687561 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf"] Jun 11 19:36:04.730340 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.730312 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb"] Jun 11 19:36:04.732613 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:36:04.732582 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5bb90e_5794_4bda_aa82_7d3826f38f55.slice/crio-629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2 WatchSource:0}: Error finding container 629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2: Status 404 returned error can't find the container with id 629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2 Jun 11 19:36:04.780230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.780201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.780377 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.780257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5j9\" (UniqueName: \"kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.780377 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.780282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.881366 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.881322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5j9\" (UniqueName: \"kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.881366 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.881373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.881633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.881454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.881920 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.881853 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.881920 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.881901 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.892095 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.892057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5j9\" (UniqueName: \"kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:04.935047 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.935002 2581 generic.go:356] "Generic (PLEG): container finished" podID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerID="637d959c8b32d54b4961fb29a965b212a1d83ee5a40f3412dafe2b4d174e8015" exitCode=0 Jun 11 19:36:04.935209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.935098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" event={"ID":"3e5bb90e-5794-4bda-aa82-7d3826f38f55","Type":"ContainerDied","Data":"637d959c8b32d54b4961fb29a965b212a1d83ee5a40f3412dafe2b4d174e8015"} Jun 11 19:36:04.935209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.935183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" event={"ID":"3e5bb90e-5794-4bda-aa82-7d3826f38f55","Type":"ContainerStarted","Data":"629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2"} Jun 11 19:36:04.937166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.937140 2581 generic.go:356] "Generic (PLEG): container finished" podID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerID="40b90ea03d3b1ae4d1bd0f3899bb92e9d9499f9d31a3fd4f1a60dad19341c422" exitCode=0 Jun 11 19:36:04.937281 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.937225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" event={"ID":"72876fdc-6930-4238-9e4f-6b3a27c64760","Type":"ContainerDied","Data":"40b90ea03d3b1ae4d1bd0f3899bb92e9d9499f9d31a3fd4f1a60dad19341c422"} Jun 11 19:36:04.937325 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:04.937287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" event={"ID":"72876fdc-6930-4238-9e4f-6b3a27c64760","Type":"ContainerStarted","Data":"1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021"} Jun 11 19:36:05.002411 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.002376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:05.067507 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.067474 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh"] Jun 11 19:36:05.071362 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.071344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.079660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.079624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh"] Jun 11 19:36:05.148563 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.148531 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf"] Jun 11 19:36:05.149800 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:36:05.149772 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439c227b_3025_4143_a37d_ed8b3d00f4a9.slice/crio-b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271 WatchSource:0}: Error finding container b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271: Status 404 returned error can't find the container with id b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271 Jun 11 19:36:05.183970 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.183927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.184115 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.184061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt6hs\" (UniqueName: \"kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.184194 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.184180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.285553 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.285510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.285742 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.285572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.285742 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.285643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt6hs\" (UniqueName: \"kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.285964 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.285943 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.286025 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.285981 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.295510 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.295482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt6hs\" (UniqueName: \"kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.383468 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.383373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:05.528515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.528474 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh"] Jun 11 19:36:05.530198 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:36:05.530176 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06319ebc_6866_4f24_99c3_9dec59ff748b.slice/crio-0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731 WatchSource:0}: Error finding container 0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731: Status 404 returned error can't find the container with id 0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731 Jun 11 19:36:05.944200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.944164 2581 generic.go:356] "Generic (PLEG): container finished" podID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerID="10ad70d4fb79a0c4f0959f48914f0d31aa02ac4071e32c36dbcf9397eb8cba89" exitCode=0 Jun 11 19:36:05.944372 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.944248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" event={"ID":"06319ebc-6866-4f24-99c3-9dec59ff748b","Type":"ContainerDied","Data":"10ad70d4fb79a0c4f0959f48914f0d31aa02ac4071e32c36dbcf9397eb8cba89"} Jun 11 19:36:05.944372 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.944303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" event={"ID":"06319ebc-6866-4f24-99c3-9dec59ff748b","Type":"ContainerStarted","Data":"0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731"} Jun 11 19:36:05.946258 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.946230 2581 generic.go:356] "Generic (PLEG): container finished" podID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerID="6388a08b8981a47aa66b96e49093c3c6022bad7ff0ac7eb750681ef5e592407a" exitCode=0 Jun 11 19:36:05.946378 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.946314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" event={"ID":"3e5bb90e-5794-4bda-aa82-7d3826f38f55","Type":"ContainerDied","Data":"6388a08b8981a47aa66b96e49093c3c6022bad7ff0ac7eb750681ef5e592407a"} Jun 11 19:36:05.948070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.948041 2581 generic.go:356] "Generic (PLEG): container finished" podID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerID="59d3b71167f7daf3897ab529587116ec87860135c8fcefc484b29e6a819f5bff" exitCode=0 Jun 11 19:36:05.948166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.948120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" event={"ID":"439c227b-3025-4143-a37d-ed8b3d00f4a9","Type":"ContainerDied","Data":"59d3b71167f7daf3897ab529587116ec87860135c8fcefc484b29e6a819f5bff"} Jun 11 19:36:05.948230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:05.948169 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" event={"ID":"439c227b-3025-4143-a37d-ed8b3d00f4a9","Type":"ContainerStarted","Data":"b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271"} Jun 11 19:36:06.956604 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:06.956572 2581 generic.go:356] "Generic (PLEG): container finished" podID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerID="84df94914ddef0f8fe51f1ea7eb3b48f132fee0420c8903553713ec112de6ba1" exitCode=0 Jun 11 19:36:06.957030 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:06.956646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" event={"ID":"72876fdc-6930-4238-9e4f-6b3a27c64760","Type":"ContainerDied","Data":"84df94914ddef0f8fe51f1ea7eb3b48f132fee0420c8903553713ec112de6ba1"} Jun 11 19:36:06.960274 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:06.960246 2581 generic.go:356] "Generic (PLEG): container finished" podID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerID="509524be921271c4709db4f03b2ef46c6cbb01837c7898489e96d073db32c2f0" exitCode=0 Jun 11 19:36:06.960409 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:06.960331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" event={"ID":"3e5bb90e-5794-4bda-aa82-7d3826f38f55","Type":"ContainerDied","Data":"509524be921271c4709db4f03b2ef46c6cbb01837c7898489e96d073db32c2f0"} Jun 11 19:36:07.968348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.968254 2581 generic.go:356] "Generic (PLEG): container finished" podID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerID="5568f8a08e2b57aca49f45993ae5d01cca70e803470d685e57df416d625a99ac" exitCode=0 Jun 11 19:36:07.968734 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.968347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" event={"ID":"439c227b-3025-4143-a37d-ed8b3d00f4a9","Type":"ContainerDied","Data":"5568f8a08e2b57aca49f45993ae5d01cca70e803470d685e57df416d625a99ac"} Jun 11 19:36:07.970385 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.970357 2581 generic.go:356] "Generic (PLEG): container finished" podID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerID="2a22979136d6e6f00c3f2241a6a458458b15b8df9d3bed931200a0b289e1926d" exitCode=0 Jun 11 19:36:07.970486 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.970388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" event={"ID":"06319ebc-6866-4f24-99c3-9dec59ff748b","Type":"ContainerDied","Data":"2a22979136d6e6f00c3f2241a6a458458b15b8df9d3bed931200a0b289e1926d"} Jun 11 19:36:07.972789 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.972764 2581 generic.go:356] "Generic (PLEG): container finished" podID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerID="f132e842792596e2656314b43940d24c5095e8ebdf4bbaf7d2a2b8f42b4170ba" exitCode=0 Jun 11 19:36:07.972890 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:07.972844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" event={"ID":"72876fdc-6930-4238-9e4f-6b3a27c64760","Type":"ContainerDied","Data":"f132e842792596e2656314b43940d24c5095e8ebdf4bbaf7d2a2b8f42b4170ba"} Jun 11 19:36:08.120604 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.120575 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:08.211614 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.211572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9md\" (UniqueName: \"kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md\") pod \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " Jun 11 19:36:08.211782 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.211623 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle\") pod \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " Jun 11 19:36:08.211782 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.211712 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util\") pod \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\" (UID: \"3e5bb90e-5794-4bda-aa82-7d3826f38f55\") " Jun 11 19:36:08.212256 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.212220 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle" (OuterVolumeSpecName: "bundle") pod "3e5bb90e-5794-4bda-aa82-7d3826f38f55" (UID: "3e5bb90e-5794-4bda-aa82-7d3826f38f55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:08.214110 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.214083 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md" (OuterVolumeSpecName: "kube-api-access-9t9md") pod "3e5bb90e-5794-4bda-aa82-7d3826f38f55" (UID: "3e5bb90e-5794-4bda-aa82-7d3826f38f55"). InnerVolumeSpecName "kube-api-access-9t9md". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:36:08.216852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.216828 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util" (OuterVolumeSpecName: "util") pod "3e5bb90e-5794-4bda-aa82-7d3826f38f55" (UID: "3e5bb90e-5794-4bda-aa82-7d3826f38f55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:08.313429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.313341 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:08.313429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.313376 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9md\" (UniqueName: \"kubernetes.io/projected/3e5bb90e-5794-4bda-aa82-7d3826f38f55-kube-api-access-9t9md\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:08.313429 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.313389 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e5bb90e-5794-4bda-aa82-7d3826f38f55-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:08.980541 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.980438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" event={"ID":"3e5bb90e-5794-4bda-aa82-7d3826f38f55","Type":"ContainerDied","Data":"629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2"} Jun 11 19:36:08.980541 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.980484 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb" Jun 11 19:36:08.980541 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.980502 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="629a94a44322f8d24e9703235322b143f811f12b1d0da70df187ec48f41d75a2" Jun 11 19:36:08.983024 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.982995 2581 generic.go:356] "Generic (PLEG): container finished" podID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerID="6f598c1b1ba20ebbaefdc08f3fec26f4cc345efc4472ab9485a19e168e2e4486" exitCode=0 Jun 11 19:36:08.983152 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.983069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" event={"ID":"439c227b-3025-4143-a37d-ed8b3d00f4a9","Type":"ContainerDied","Data":"6f598c1b1ba20ebbaefdc08f3fec26f4cc345efc4472ab9485a19e168e2e4486"} Jun 11 19:36:08.985087 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.985066 2581 generic.go:356] "Generic (PLEG): container finished" podID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerID="2b8238fc1db506ba8eaadd86301d7d77bbc25358493b155c10a5975c51d1abc8" exitCode=0 Jun 11 19:36:08.985182 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:08.985146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" event={"ID":"06319ebc-6866-4f24-99c3-9dec59ff748b","Type":"ContainerDied","Data":"2b8238fc1db506ba8eaadd86301d7d77bbc25358493b155c10a5975c51d1abc8"} Jun 11 19:36:09.120220 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.120192 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:09.221067 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.221033 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4kww\" (UniqueName: \"kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww\") pod \"72876fdc-6930-4238-9e4f-6b3a27c64760\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " Jun 11 19:36:09.221234 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.221138 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle\") pod \"72876fdc-6930-4238-9e4f-6b3a27c64760\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " Jun 11 19:36:09.221234 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.221182 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util\") pod \"72876fdc-6930-4238-9e4f-6b3a27c64760\" (UID: \"72876fdc-6930-4238-9e4f-6b3a27c64760\") " Jun 11 19:36:09.221700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.221676 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle" (OuterVolumeSpecName: "bundle") pod "72876fdc-6930-4238-9e4f-6b3a27c64760" (UID: "72876fdc-6930-4238-9e4f-6b3a27c64760"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:09.223291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.223254 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww" (OuterVolumeSpecName: "kube-api-access-r4kww") pod "72876fdc-6930-4238-9e4f-6b3a27c64760" (UID: "72876fdc-6930-4238-9e4f-6b3a27c64760"). InnerVolumeSpecName "kube-api-access-r4kww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:36:09.269224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.269131 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util" (OuterVolumeSpecName: "util") pod "72876fdc-6930-4238-9e4f-6b3a27c64760" (UID: "72876fdc-6930-4238-9e4f-6b3a27c64760"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:09.322927 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.322858 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:09.322927 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.322921 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72876fdc-6930-4238-9e4f-6b3a27c64760-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:09.322927 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.322932 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4kww\" (UniqueName: \"kubernetes.io/projected/72876fdc-6930-4238-9e4f-6b3a27c64760-kube-api-access-r4kww\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:09.992924 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.992891 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" Jun 11 19:36:09.992924 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.992895 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q" event={"ID":"72876fdc-6930-4238-9e4f-6b3a27c64760","Type":"ContainerDied","Data":"1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021"} Jun 11 19:36:09.993361 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:09.992959 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b7e9209cf500a9615b62a9ef300c8e0621a3e23db6fa4a052f826aac421f021" Jun 11 19:36:10.158156 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.158105 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:10.162290 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.162267 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:10.231070 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231033 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util\") pod \"06319ebc-6866-4f24-99c3-9dec59ff748b\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " Jun 11 19:36:10.231262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt6hs\" (UniqueName: \"kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs\") pod \"06319ebc-6866-4f24-99c3-9dec59ff748b\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " Jun 11 19:36:10.231262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle\") pod \"439c227b-3025-4143-a37d-ed8b3d00f4a9\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " Jun 11 19:36:10.231262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231181 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle\") pod \"06319ebc-6866-4f24-99c3-9dec59ff748b\" (UID: \"06319ebc-6866-4f24-99c3-9dec59ff748b\") " Jun 11 19:36:10.231262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util\") pod \"439c227b-3025-4143-a37d-ed8b3d00f4a9\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " Jun 11 19:36:10.231262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231246 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm5j9\" (UniqueName: \"kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9\") pod \"439c227b-3025-4143-a37d-ed8b3d00f4a9\" (UID: \"439c227b-3025-4143-a37d-ed8b3d00f4a9\") " Jun 11 19:36:10.231983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231671 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle" (OuterVolumeSpecName: "bundle") pod "439c227b-3025-4143-a37d-ed8b3d00f4a9" (UID: "439c227b-3025-4143-a37d-ed8b3d00f4a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:10.231983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.231830 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle" (OuterVolumeSpecName: "bundle") pod "06319ebc-6866-4f24-99c3-9dec59ff748b" (UID: "06319ebc-6866-4f24-99c3-9dec59ff748b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:10.233581 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.233551 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs" (OuterVolumeSpecName: "kube-api-access-qt6hs") pod "06319ebc-6866-4f24-99c3-9dec59ff748b" (UID: "06319ebc-6866-4f24-99c3-9dec59ff748b"). InnerVolumeSpecName "kube-api-access-qt6hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:36:10.233962 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.233847 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9" (OuterVolumeSpecName: "kube-api-access-nm5j9") pod "439c227b-3025-4143-a37d-ed8b3d00f4a9" (UID: "439c227b-3025-4143-a37d-ed8b3d00f4a9"). InnerVolumeSpecName "kube-api-access-nm5j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:36:10.237198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.237170 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util" (OuterVolumeSpecName: "util") pod "06319ebc-6866-4f24-99c3-9dec59ff748b" (UID: "06319ebc-6866-4f24-99c3-9dec59ff748b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:10.237694 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.237669 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util" (OuterVolumeSpecName: "util") pod "439c227b-3025-4143-a37d-ed8b3d00f4a9" (UID: "439c227b-3025-4143-a37d-ed8b3d00f4a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332363 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332397 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt6hs\" (UniqueName: \"kubernetes.io/projected/06319ebc-6866-4f24-99c3-9dec59ff748b-kube-api-access-qt6hs\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332409 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332420 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06319ebc-6866-4f24-99c3-9dec59ff748b-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332427 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439c227b-3025-4143-a37d-ed8b3d00f4a9-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:10.332451 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:10.332436 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm5j9\" (UniqueName: \"kubernetes.io/projected/439c227b-3025-4143-a37d-ed8b3d00f4a9-kube-api-access-nm5j9\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:36:11.004299 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.004250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" event={"ID":"439c227b-3025-4143-a37d-ed8b3d00f4a9","Type":"ContainerDied","Data":"b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271"} Jun 11 19:36:11.004771 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.004365 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4b422d1b8beb07ad3172c6f2dd65b39a216dbc6da3ad802d3cd5643f4805271" Jun 11 19:36:11.004771 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.004486 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf" Jun 11 19:36:11.007769 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.007738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" event={"ID":"06319ebc-6866-4f24-99c3-9dec59ff748b","Type":"ContainerDied","Data":"0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731"} Jun 11 19:36:11.007917 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.007782 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d6992d528a697cc2dc7c0aaa7feb6be8c0dec8777c4453d07f38f7bb9ec0731" Jun 11 19:36:11.007917 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:11.007784 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh" Jun 11 19:36:18.882445 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:18.882409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:21.234650 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:21.234598 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:22.385534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:22.385506 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:36:22.387091 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:22.387065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:36:23.681270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:23.681239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:27.075066 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:27.075028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:27.882209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:27.882167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:32.080399 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:32.080358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:39.934129 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:39.934046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:41.955367 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:41.955333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:43.144037 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:43.143996 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:45.021112 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:45.021066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:45.114599 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:45.114560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:47.454245 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454210 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr"] Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454606 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454626 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454641 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454647 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454663 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="pull" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454668 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="pull" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454675 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454680 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="extract" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454688 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="util" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454693 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="util" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454700 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="util" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454709 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="util" Jun 11 19:36:47.454711 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454718 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454725 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454736 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="util" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454741 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="util" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454749 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="util" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454755 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="util" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454762 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454767 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454772 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="extract" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454778 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="extract" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454791 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454798 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="pull" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454854 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72876fdc-6930-4238-9e4f-6b3a27c64760" containerName="extract" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454888 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06319ebc-6866-4f24-99c3-9dec59ff748b" containerName="extract" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454898 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5bb90e-5794-4bda-aa82-7d3826f38f55" containerName="extract" Jun 11 19:36:47.455447 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.454905 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="439c227b-3025-4143-a37d-ed8b3d00f4a9" containerName="extract" Jun 11 19:36:47.458056 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.458039 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.460522 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.460497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 19:36:47.460675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.460497 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 19:36:47.460675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.460503 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 19:36:47.460675 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.460507 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 19:36:47.461289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.461271 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bqd9q\"" Jun 11 19:36:47.466816 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.466364 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr"] Jun 11 19:36:47.494763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.494723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:47.537764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.537726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btfpr\" (UniqueName: \"kubernetes.io/projected/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-kube-api-access-btfpr\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.537966 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.537784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.537966 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.537842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.639394 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.639349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btfpr\" (UniqueName: \"kubernetes.io/projected/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-kube-api-access-btfpr\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.639718 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.639447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.639718 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.639509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.639718 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:36:47.639610 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 19:36:47.639718 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:36:47.639689 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert podName:3bb1c615-542a-4a48-9d4d-4fb6c64bceef nodeName:}" failed. No retries permitted until 2026-06-11 19:36:48.139666406 +0000 UTC m=+626.191451444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rwrfr" (UID: "3bb1c615-542a-4a48-9d4d-4fb6c64bceef") : secret "plugin-serving-cert" not found Jun 11 19:36:47.640282 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.640263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.651065 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.651036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btfpr\" (UniqueName: \"kubernetes.io/projected/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-kube-api-access-btfpr\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:47.905309 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:47.905271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:48.144175 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.144129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:48.146745 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.146718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bb1c615-542a-4a48-9d4d-4fb6c64bceef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwrfr\" (UID: \"3bb1c615-542a-4a48-9d4d-4fb6c64bceef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:48.298894 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.298782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:48.369770 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.369725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" Jun 11 19:36:48.399166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.399134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:48.515601 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.515572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr"] Jun 11 19:36:48.516923 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:36:48.516897 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bb1c615_542a_4a48_9d4d_4fb6c64bceef.slice/crio-bae474ec0270afc91f1043e6e9e4774c452cb8e659eb91cff49e776d9a5ae566 WatchSource:0}: Error finding container bae474ec0270afc91f1043e6e9e4774c452cb8e659eb91cff49e776d9a5ae566: Status 404 returned error can't find the container with id bae474ec0270afc91f1043e6e9e4774c452cb8e659eb91cff49e776d9a5ae566 Jun 11 19:36:48.871946 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.871896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:48.972167 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:48.972133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:49.234280 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:49.234181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" event={"ID":"3bb1c615-542a-4a48-9d4d-4fb6c64bceef","Type":"ContainerStarted","Data":"bae474ec0270afc91f1043e6e9e4774c452cb8e659eb91cff49e776d9a5ae566"} Jun 11 19:36:52.675017 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:52.674985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:52.737899 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:52.737798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:58.980986 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:58.980943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:59.087605 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:36:59.087546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:01.798925 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:01.798855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:01.902432 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:01.902391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:06.591180 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:06.591144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:06.687597 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:06.687557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:10.138850 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:10.138772 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:10.233511 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:10.233477 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:13.392948 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:13.392905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" event={"ID":"3bb1c615-542a-4a48-9d4d-4fb6c64bceef","Type":"ContainerStarted","Data":"3c2ef6dcf848349637ad0f48f6f9257aa7539b3e51ee6892835d7fa7e16b30cf"} Jun 11 19:37:13.429629 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:13.429562 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwrfr" podStartSLOduration=2.149305916 podStartE2EDuration="26.429542056s" totalImagesPullingTime="24.28023614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:37:13.42826554 +0000 UTC m=+651.480050602" watchObservedRunningTime="2026-06-11 19:37:13.429542056 +0000 UTC m=+651.481327121" Jun 11 19:37:16.775397 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:16.775336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:16.875545 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:16.875498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:20.194153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:20.194090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:20.341009 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:20.340953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:24.579023 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:24.578981 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:24.636707 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:24.636665 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:24.771612 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:24.771559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:24.828764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:24.828732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:27.000425 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:27.000391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:27.191349 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:27.191319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:29.780852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:29.780819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:29.839666 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:29.839621 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:41.271428 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.271391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:41.376173 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.376131 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:41.430249 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.430210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:41.587861 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.587818 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:37:41.733825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.733791 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:37:41.733825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.733833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:37:41.734065 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.733948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.736253 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.736227 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 19:37:41.853660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.853571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-config-file\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.853660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.853616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpz9j\" (UniqueName: \"kubernetes.io/projected/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-kube-api-access-jpz9j\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.954809 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.954765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-config-file\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.954809 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.954810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpz9j\" (UniqueName: \"kubernetes.io/projected/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-kube-api-access-jpz9j\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.955501 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.955475 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-config-file\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:41.962747 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:41.962712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpz9j\" (UniqueName: \"kubernetes.io/projected/b2cbfe2c-71b9-4d0e-b81e-4cbf80715062-kube-api-access-jpz9j\") pod \"limitador-limitador-54d6d988d5-pf5wj\" (UID: \"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:42.044588 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.044547 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:42.060781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.060743 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:42.069757 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.069277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:42.071784 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.071754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m2ss7\"" Jun 11 19:37:42.072547 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.072514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:42.095852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.095659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:42.156579 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.156546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvftd\" (UniqueName: \"kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd\") pod \"authorino-58cd955675-k9skq\" (UID: \"fc7f6de3-16ac-4419-8ff0-67683380f203\") " pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:42.172035 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.172001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:42.228631 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.228597 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:37:42.231378 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:37:42.231342 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cbfe2c_71b9_4d0e_b81e_4cbf80715062.slice/crio-a9847b0a2f30cb453a868a72e0d7c5ea32fa09ecf6230869997f6d6bbe2fe038 WatchSource:0}: Error finding container a9847b0a2f30cb453a868a72e0d7c5ea32fa09ecf6230869997f6d6bbe2fe038: Status 404 returned error can't find the container with id a9847b0a2f30cb453a868a72e0d7c5ea32fa09ecf6230869997f6d6bbe2fe038 Jun 11 19:37:42.233497 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.233474 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:37:42.257798 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.257759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvftd\" (UniqueName: \"kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd\") pod \"authorino-58cd955675-k9skq\" (UID: \"fc7f6de3-16ac-4419-8ff0-67683380f203\") " pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:42.270738 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.270711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvftd\" (UniqueName: \"kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd\") pod \"authorino-58cd955675-k9skq\" (UID: \"fc7f6de3-16ac-4419-8ff0-67683380f203\") " pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:42.277827 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.277790 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:37:42.305306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.305263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:37:42.305465 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.305373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:37:42.398730 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.398637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:42.460229 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.460190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zgd\" (UniqueName: \"kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd\") pod \"authorino-75d556bd77-tz4dj\" (UID: \"5973b686-34b9-4e72-a8a0-d900aea41904\") " pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:37:42.557235 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.557195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:42.557414 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.557351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" event={"ID":"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062","Type":"ContainerStarted","Data":"a9847b0a2f30cb453a868a72e0d7c5ea32fa09ecf6230869997f6d6bbe2fe038"} Jun 11 19:37:42.560738 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:37:42.560697 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc7f6de3_16ac_4419_8ff0_67683380f203.slice/crio-503a373eb85124078bbad646a733d6cecd3c8f27495039400b4be021caf427fc WatchSource:0}: Error finding container 503a373eb85124078bbad646a733d6cecd3c8f27495039400b4be021caf427fc: Status 404 returned error can't find the container with id 503a373eb85124078bbad646a733d6cecd3c8f27495039400b4be021caf427fc Jun 11 19:37:42.560889 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.560803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zgd\" (UniqueName: \"kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd\") pod \"authorino-75d556bd77-tz4dj\" (UID: \"5973b686-34b9-4e72-a8a0-d900aea41904\") " pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:37:42.572993 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.572966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zgd\" (UniqueName: \"kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd\") pod \"authorino-75d556bd77-tz4dj\" (UID: \"5973b686-34b9-4e72-a8a0-d900aea41904\") " pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:37:42.615906 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.615849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:37:42.830421 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.830364 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:37:42.832545 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:37:42.832509 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5973b686_34b9_4e72_a8a0_d900aea41904.slice/crio-dd4c05987b080e285545e137caecfdd54ca48df034ef6832b2a1575c304d4764 WatchSource:0}: Error finding container dd4c05987b080e285545e137caecfdd54ca48df034ef6832b2a1575c304d4764: Status 404 returned error can't find the container with id dd4c05987b080e285545e137caecfdd54ca48df034ef6832b2a1575c304d4764 Jun 11 19:37:42.852850 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.852800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:42.911405 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:42.911359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:43.443993 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.443960 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bff7c8f8f-tbnvm"] Jun 11 19:37:43.464523 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.464488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bff7c8f8f-tbnvm"] Jun 11 19:37:43.464702 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.464638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.503317 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.503262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:43.565394 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.565354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:43.570555 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.570515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k9skq" event={"ID":"fc7f6de3-16ac-4419-8ff0-67683380f203","Type":"ContainerStarted","Data":"503a373eb85124078bbad646a733d6cecd3c8f27495039400b4be021caf427fc"} Jun 11 19:37:43.572488 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-oauth-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-trusted-ca-bundle\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-oauth-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8sd\" (UniqueName: \"kubernetes.io/projected/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-kube-api-access-gq8sd\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-service-ca\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.572957 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.572679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.573613 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.573584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tz4dj" event={"ID":"5973b686-34b9-4e72-a8a0-d900aea41904","Type":"ContainerStarted","Data":"dd4c05987b080e285545e137caecfdd54ca48df034ef6832b2a1575c304d4764"} Jun 11 19:37:43.638601 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.638566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:43.673543 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8sd\" (UniqueName: \"kubernetes.io/projected/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-kube-api-access-gq8sd\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.673739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-service-ca\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.673739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.673739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.673739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-oauth-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.673739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-trusted-ca-bundle\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.674046 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.673789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-oauth-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.674543 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.674512 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-service-ca\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.674648 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.674512 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-oauth-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.675179 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.675149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.675978 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.675950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-trusted-ca-bundle\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.679344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.679295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-oauth-config\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.682094 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.682056 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-console-serving-cert\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.683613 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.683573 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8sd\" (UniqueName: \"kubernetes.io/projected/329df90e-f41b-47a3-ad61-b1c99f7d1ed9-kube-api-access-gq8sd\") pod \"console-bff7c8f8f-tbnvm\" (UID: \"329df90e-f41b-47a3-ad61-b1c99f7d1ed9\") " pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:43.739934 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.739797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:43.779145 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:43.778819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:44.241680 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:44.241637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:44.299702 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:44.299660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:46.425979 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:46.425949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bff7c8f8f-tbnvm"] Jun 11 19:37:46.936383 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:37:46.936346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329df90e_f41b_47a3_ad61_b1c99f7d1ed9.slice/crio-fa3d880ff11aab30ff2a98402d895367ba4d5a2ec76b428a97cd1f923c780e13 WatchSource:0}: Error finding container fa3d880ff11aab30ff2a98402d895367ba4d5a2ec76b428a97cd1f923c780e13: Status 404 returned error can't find the container with id fa3d880ff11aab30ff2a98402d895367ba4d5a2ec76b428a97cd1f923c780e13 Jun 11 19:37:47.610121 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.610086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" event={"ID":"b2cbfe2c-71b9-4d0e-b81e-4cbf80715062","Type":"ContainerStarted","Data":"8df779bd8dccdc91abc16ab6f285087f0cdd5d341657c30edd45f0236b60fbf6"} Jun 11 19:37:47.610570 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.610202 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:37:47.611739 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.611708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k9skq" event={"ID":"fc7f6de3-16ac-4419-8ff0-67683380f203","Type":"ContainerStarted","Data":"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068"} Jun 11 19:37:47.613289 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.613266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tz4dj" event={"ID":"5973b686-34b9-4e72-a8a0-d900aea41904","Type":"ContainerStarted","Data":"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899"} Jun 11 19:37:47.614800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.614777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bff7c8f8f-tbnvm" event={"ID":"329df90e-f41b-47a3-ad61-b1c99f7d1ed9","Type":"ContainerStarted","Data":"291fa5036b7fb77d2ace40882483a4f3b3083337e32ae9a6d75f243f10568e9b"} Jun 11 19:37:47.614961 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.614821 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bff7c8f8f-tbnvm" event={"ID":"329df90e-f41b-47a3-ad61-b1c99f7d1ed9","Type":"ContainerStarted","Data":"fa3d880ff11aab30ff2a98402d895367ba4d5a2ec76b428a97cd1f923c780e13"} Jun 11 19:37:47.627115 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.627071 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" podStartSLOduration=1.8440128850000002 podStartE2EDuration="6.627056014s" totalImagesPullingTime="4.783043129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:37:47.625242717 +0000 UTC m=+685.677027780" watchObservedRunningTime="2026-06-11 19:37:47.627056014 +0000 UTC m=+685.678841074" Jun 11 19:37:47.642692 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.642631 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-k9skq" podStartSLOduration=1.186605246 podStartE2EDuration="5.642612423s" totalImagesPullingTime="4.456007177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:37:47.63946553 +0000 UTC m=+685.691250593" watchObservedRunningTime="2026-06-11 19:37:47.642612423 +0000 UTC m=+685.694397489" Jun 11 19:37:47.656972 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.656897 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tz4dj" podStartSLOduration=1.470157152 podStartE2EDuration="5.656856122s" totalImagesPullingTime="4.18669897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:37:47.654117579 +0000 UTC m=+685.705902641" watchObservedRunningTime="2026-06-11 19:37:47.656856122 +0000 UTC m=+685.708641184" Jun 11 19:37:47.676723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.676659 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bff7c8f8f-tbnvm" podStartSLOduration=4.6766426370000005 podStartE2EDuration="4.676642637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:37:47.674584398 +0000 UTC m=+685.726369459" watchObservedRunningTime="2026-06-11 19:37:47.676642637 +0000 UTC m=+685.728427697" Jun 11 19:37:47.683524 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:47.683492 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:49.627515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:49.627470 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-k9skq" podUID="fc7f6de3-16ac-4419-8ff0-67683380f203" containerName="authorino" containerID="cri-o://d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068" gracePeriod=30 Jun 11 19:37:49.884321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:49.884245 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:50.040184 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.040148 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvftd\" (UniqueName: \"kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd\") pod \"fc7f6de3-16ac-4419-8ff0-67683380f203\" (UID: \"fc7f6de3-16ac-4419-8ff0-67683380f203\") " Jun 11 19:37:50.042427 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.042403 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd" (OuterVolumeSpecName: "kube-api-access-jvftd") pod "fc7f6de3-16ac-4419-8ff0-67683380f203" (UID: "fc7f6de3-16ac-4419-8ff0-67683380f203"). InnerVolumeSpecName "kube-api-access-jvftd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:37:50.141184 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.141097 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvftd\" (UniqueName: \"kubernetes.io/projected/fc7f6de3-16ac-4419-8ff0-67683380f203-kube-api-access-jvftd\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:37:50.635235 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.635191 2581 generic.go:356] "Generic (PLEG): container finished" podID="fc7f6de3-16ac-4419-8ff0-67683380f203" containerID="d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068" exitCode=0 Jun 11 19:37:50.635722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.635258 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k9skq" Jun 11 19:37:50.635722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.635278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k9skq" event={"ID":"fc7f6de3-16ac-4419-8ff0-67683380f203","Type":"ContainerDied","Data":"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068"} Jun 11 19:37:50.635722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.635336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k9skq" event={"ID":"fc7f6de3-16ac-4419-8ff0-67683380f203","Type":"ContainerDied","Data":"503a373eb85124078bbad646a733d6cecd3c8f27495039400b4be021caf427fc"} Jun 11 19:37:50.635722 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.635362 2581 scope.go:117] "RemoveContainer" containerID="d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068" Jun 11 19:37:50.645064 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.645014 2581 scope.go:117] "RemoveContainer" containerID="d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068" Jun 11 19:37:50.645347 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:37:50.645325 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068\": container with ID starting with d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068 not found: ID does not exist" containerID="d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068" Jun 11 19:37:50.645418 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.645357 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068"} err="failed to get container status \"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068\": rpc error: code = NotFound desc = could not find container \"d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068\": container with ID starting with d533b3619443f552132e302d4c87c1fd9a2dcd41e73a84691a8912dea0149068 not found: ID does not exist" Jun 11 19:37:50.651843 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.651817 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:50.655358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:50.655334 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-k9skq"] Jun 11 19:37:52.380656 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:52.380620 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc7f6de3-16ac-4419-8ff0-67683380f203" path="/var/lib/kubelet/pods/fc7f6de3-16ac-4419-8ff0-67683380f203/volumes" Jun 11 19:37:53.780019 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:53.779982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:53.780412 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:53.780035 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:53.785195 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:53.785167 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:54.663139 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:54.663110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bff7c8f8f-tbnvm" Jun 11 19:37:54.709305 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:54.709273 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:37:54.820781 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:54.820750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:54.921363 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:54.921280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:54.970504 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:54.970475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:58.622044 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:37:58.622010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pf5wj" Jun 11 19:38:00.263204 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:00.263163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:10.106547 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:10.106444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:10.211584 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:10.211549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:10.351732 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:10.351691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:11.201417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.201379 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8"] Jun 11 19:38:11.201909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.201767 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc7f6de3-16ac-4419-8ff0-67683380f203" containerName="authorino" Jun 11 19:38:11.201909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.201778 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc7f6de3-16ac-4419-8ff0-67683380f203" containerName="authorino" Jun 11 19:38:11.201909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.201840 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc7f6de3-16ac-4419-8ff0-67683380f203" containerName="authorino" Jun 11 19:38:11.204899 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.204860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.207396 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.207373 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pbgqn\"" Jun 11 19:38:11.207396 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.207386 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:38:11.208240 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.208222 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:38:11.215139 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.215114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8"] Jun 11 19:38:11.231735 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.231697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.231965 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.231761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.231965 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.231833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvcd9\" (UniqueName: \"kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.333412 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.333365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.333640 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.333446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.333640 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.333479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvcd9\" (UniqueName: \"kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.333791 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.333769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.333852 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.333797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.343899 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.343861 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvcd9\" (UniqueName: \"kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.515813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.515710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:11.660749 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.660715 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8"] Jun 11 19:38:11.662326 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:38:11.662295 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e7e34f_1555_422f_9b58_c63363a07f75.slice/crio-657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192 WatchSource:0}: Error finding container 657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192: Status 404 returned error can't find the container with id 657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192 Jun 11 19:38:11.761195 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.761157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerStarted","Data":"e7e219ccaff0f42c2733924711065d7797e1603b471215d69dee104d6852b32b"} Jun 11 19:38:11.761195 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:11.761213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerStarted","Data":"657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192"} Jun 11 19:38:12.647638 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:12.647557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:12.769306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:12.769267 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerID="e7e219ccaff0f42c2733924711065d7797e1603b471215d69dee104d6852b32b" exitCode=0 Jun 11 19:38:12.769633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:12.769313 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerDied","Data":"e7e219ccaff0f42c2733924711065d7797e1603b471215d69dee104d6852b32b"} Jun 11 19:38:13.777755 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:13.777658 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerID="3081973eb57846b8798916d5140832cf15d297c4c9a83c4037214ab0f794ff3b" exitCode=0 Jun 11 19:38:13.777755 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:13.777741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerDied","Data":"3081973eb57846b8798916d5140832cf15d297c4c9a83c4037214ab0f794ff3b"} Jun 11 19:38:14.786418 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:14.786382 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerID="d0c1241de7e5fcc9b431012d51b435b6eadc765fc0a9d1072ac9c0dd680fde2d" exitCode=0 Jun 11 19:38:14.786780 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:14.786447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerDied","Data":"d0c1241de7e5fcc9b431012d51b435b6eadc765fc0a9d1072ac9c0dd680fde2d"} Jun 11 19:38:15.945207 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.945178 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:15.975633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.975600 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle\") pod \"c8e7e34f-1555-422f-9b58-c63363a07f75\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " Jun 11 19:38:15.975633 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.975644 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvcd9\" (UniqueName: \"kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9\") pod \"c8e7e34f-1555-422f-9b58-c63363a07f75\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " Jun 11 19:38:15.975857 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.975703 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util\") pod \"c8e7e34f-1555-422f-9b58-c63363a07f75\" (UID: \"c8e7e34f-1555-422f-9b58-c63363a07f75\") " Jun 11 19:38:15.976178 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.976151 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle" (OuterVolumeSpecName: "bundle") pod "c8e7e34f-1555-422f-9b58-c63363a07f75" (UID: "c8e7e34f-1555-422f-9b58-c63363a07f75"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:38:15.978058 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.978030 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9" (OuterVolumeSpecName: "kube-api-access-pvcd9") pod "c8e7e34f-1555-422f-9b58-c63363a07f75" (UID: "c8e7e34f-1555-422f-9b58-c63363a07f75"). InnerVolumeSpecName "kube-api-access-pvcd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:38:15.985851 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:15.985810 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util" (OuterVolumeSpecName: "util") pod "c8e7e34f-1555-422f-9b58-c63363a07f75" (UID: "c8e7e34f-1555-422f-9b58-c63363a07f75"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:38:16.077034 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.076934 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-util\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:16.077034 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.076966 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8e7e34f-1555-422f-9b58-c63363a07f75-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:16.077034 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.076977 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvcd9\" (UniqueName: \"kubernetes.io/projected/c8e7e34f-1555-422f-9b58-c63363a07f75-kube-api-access-pvcd9\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:16.799931 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.799815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" event={"ID":"c8e7e34f-1555-422f-9b58-c63363a07f75","Type":"ContainerDied","Data":"657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192"} Jun 11 19:38:16.799931 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.799899 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7484mmr8" Jun 11 19:38:16.800118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:16.799904 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="657edcddc291096c640220359f205d1e95421befe721b01441c277e9c36a7192" Jun 11 19:38:19.736548 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:19.736488 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5dbc585bf8-rds4j" podUID="95be9cf9-4055-4409-b52d-43a6891040b8" containerName="console" containerID="cri-o://b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c" gracePeriod=15 Jun 11 19:38:19.989983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:19.989917 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:38:20.114482 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114439 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114482 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114485 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114554 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbk9t\" (UniqueName: \"kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114592 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114678 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.114723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114709 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca\") pod \"95be9cf9-4055-4409-b52d-43a6891040b8\" (UID: \"95be9cf9-4055-4409-b52d-43a6891040b8\") " Jun 11 19:38:20.115013 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.114982 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config" (OuterVolumeSpecName: "console-config") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:38:20.115078 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.115033 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:38:20.115133 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.115100 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:38:20.115187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.115168 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-console-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.115187 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.115182 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-oauth-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.115394 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.115364 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:38:20.117148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.117111 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:38:20.117263 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.117240 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t" (OuterVolumeSpecName: "kube-api-access-xbk9t") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "kube-api-access-xbk9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:38:20.117311 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.117237 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95be9cf9-4055-4409-b52d-43a6891040b8" (UID: "95be9cf9-4055-4409-b52d-43a6891040b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:38:20.216022 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.215978 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-trusted-ca-bundle\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.216022 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.216017 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbk9t\" (UniqueName: \"kubernetes.io/projected/95be9cf9-4055-4409-b52d-43a6891040b8-kube-api-access-xbk9t\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.216022 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.216028 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-serving-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.216262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.216036 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95be9cf9-4055-4409-b52d-43a6891040b8-console-oauth-config\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.216262 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.216047 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95be9cf9-4055-4409-b52d-43a6891040b8-service-ca\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:38:20.824100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.823990 2581 generic.go:356] "Generic (PLEG): container finished" podID="95be9cf9-4055-4409-b52d-43a6891040b8" containerID="b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c" exitCode=0 Jun 11 19:38:20.824100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.824046 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbc585bf8-rds4j" Jun 11 19:38:20.824100 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.824074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbc585bf8-rds4j" event={"ID":"95be9cf9-4055-4409-b52d-43a6891040b8","Type":"ContainerDied","Data":"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c"} Jun 11 19:38:20.824612 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.824127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbc585bf8-rds4j" event={"ID":"95be9cf9-4055-4409-b52d-43a6891040b8","Type":"ContainerDied","Data":"82d641bb9fd376004bda1df3127702cb25b64e5032368986def0400868e23583"} Jun 11 19:38:20.824612 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.824148 2581 scope.go:117] "RemoveContainer" containerID="b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c" Jun 11 19:38:20.834224 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.834203 2581 scope.go:117] "RemoveContainer" containerID="b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c" Jun 11 19:38:20.834561 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:38:20.834517 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c\": container with ID starting with b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c not found: ID does not exist" containerID="b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c" Jun 11 19:38:20.834654 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.834573 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c"} err="failed to get container status \"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c\": rpc error: code = NotFound desc = could not find container \"b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c\": container with ID starting with b2b0d003995c84887718b90dc8a76e10ab7895e88c449f4ed5cf9c315095119c not found: ID does not exist" Jun 11 19:38:20.842137 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.842096 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:38:20.845361 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:20.845331 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dbc585bf8-rds4j"] Jun 11 19:38:22.385807 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:22.385766 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95be9cf9-4055-4409-b52d-43a6891040b8" path="/var/lib/kubelet/pods/95be9cf9-4055-4409-b52d-43a6891040b8/volumes" Jun 11 19:38:41.127709 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.127668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:41.178498 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.178462 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:38:41.487123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487031 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:41.487425 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487413 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="util" Jun 11 19:38:41.487467 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487427 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="util" Jun 11 19:38:41.487467 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487439 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95be9cf9-4055-4409-b52d-43a6891040b8" containerName="console" Jun 11 19:38:41.487467 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487445 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95be9cf9-4055-4409-b52d-43a6891040b8" containerName="console" Jun 11 19:38:41.487467 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487455 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="extract" Jun 11 19:38:41.487467 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487462 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="extract" Jun 11 19:38:41.487617 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487475 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="pull" Jun 11 19:38:41.487617 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487480 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="pull" Jun 11 19:38:41.487617 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487540 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95be9cf9-4055-4409-b52d-43a6891040b8" containerName="console" Jun 11 19:38:41.487617 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.487550 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e7e34f-1555-422f-9b58-c63363a07f75" containerName="extract" Jun 11 19:38:41.489773 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.489754 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:41.492209 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.492174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 19:38:41.492354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.492263 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 19:38:41.492354 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.492296 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tvj5h\"" Jun 11 19:38:41.492919 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.492903 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 19:38:41.503503 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.503469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:41.622614 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.622576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2q9n\" (UniqueName: \"kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n\") pod \"maas-keycloak-0\" (UID: \"dfcfaccb-e606-47ce-9ce6-89951ed0585c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:41.723344 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.723299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2q9n\" (UniqueName: \"kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n\") pod \"maas-keycloak-0\" (UID: \"dfcfaccb-e606-47ce-9ce6-89951ed0585c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:41.731980 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.731938 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2q9n\" (UniqueName: \"kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n\") pod \"maas-keycloak-0\" (UID: \"dfcfaccb-e606-47ce-9ce6-89951ed0585c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:41.800112 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.800002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:41.943684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:41.943650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:41.944937 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:38:41.944908 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcfaccb_e606_47ce_9ce6_89951ed0585c.slice/crio-3a8b7d63a4df4e74e5037ff23b43a4855cdb5841b45be212dad6c6d0edb2a9a2 WatchSource:0}: Error finding container 3a8b7d63a4df4e74e5037ff23b43a4855cdb5841b45be212dad6c6d0edb2a9a2: Status 404 returned error can't find the container with id 3a8b7d63a4df4e74e5037ff23b43a4855cdb5841b45be212dad6c6d0edb2a9a2 Jun 11 19:38:42.958950 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:42.958854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfcfaccb-e606-47ce-9ce6-89951ed0585c","Type":"ContainerStarted","Data":"3a8b7d63a4df4e74e5037ff23b43a4855cdb5841b45be212dad6c6d0edb2a9a2"} Jun 11 19:38:47.000176 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:47.000075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfcfaccb-e606-47ce-9ce6-89951ed0585c","Type":"ContainerStarted","Data":"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019"} Jun 11 19:38:47.018384 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:47.018315 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.302088973 podStartE2EDuration="6.018297979s" totalImagesPullingTime="4.716209006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:38:47.015948955 +0000 UTC m=+745.067734018" watchObservedRunningTime="2026-06-11 19:38:47.018297979 +0000 UTC m=+745.070083040" Jun 11 19:38:47.800710 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:47.800660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:47.802536 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:47.802500 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:48.801302 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:48.801252 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:49.801319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:49.801275 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:50.800491 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:50.800445 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:51.801038 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:51.800992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:51.801879 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:51.801379 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:52.801789 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:52.801303 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:53.801154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:53.801087 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:54.800535 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:54.800479 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:55.800638 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:55.800588 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:56.800942 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:56.800856 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:57.801201 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:57.801143 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:58.800815 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:58.800761 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:38:59.800997 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:38:59.800946 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 19:39:00.914751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:00.914034 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 19:39:00.929508 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:00.929453 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:39:10.922042 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:10.922003 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:39:11.571767 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.571729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:11.795046 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.795007 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6hsnj"] Jun 11 19:39:11.797475 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.797454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:11.803226 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.803182 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6hsnj"] Jun 11 19:39:11.833729 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.833635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:11.950512 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:11.950472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqzgq\" (UniqueName: \"kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq\") pod \"authorino-5d4b67c446-6hsnj\" (UID: \"a411afc4-9efe-4da9-b517-c630e3ac61ae\") " pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:12.036376 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.036332 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6hsnj"] Jun 11 19:39:12.036677 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:39:12.036651 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kqzgq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-6hsnj" podUID="a411afc4-9efe-4da9-b517-c630e3ac61ae" Jun 11 19:39:12.051625 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.051584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqzgq\" (UniqueName: \"kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq\") pod \"authorino-5d4b67c446-6hsnj\" (UID: \"a411afc4-9efe-4da9-b517-c630e3ac61ae\") " pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:12.063503 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.063468 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-776b54f7d9-bmrrv"] Jun 11 19:39:12.064705 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.064675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqzgq\" (UniqueName: \"kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq\") pod \"authorino-5d4b67c446-6hsnj\" (UID: \"a411afc4-9efe-4da9-b517-c630e3ac61ae\") " pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:12.065983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.065967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:12.074325 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.074293 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-776b54f7d9-bmrrv"] Jun 11 19:39:12.199820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.199782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:12.201791 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.201761 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-776b54f7d9-bmrrv"] Jun 11 19:39:12.202116 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:39:12.202091 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pkq52], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-776b54f7d9-bmrrv" podUID="319fe903-dc66-454b-9cd5-9264d1a85499" Jun 11 19:39:12.206003 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.205985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:12.235476 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.235443 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:39:12.237800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.237783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.241448 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.241427 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 19:39:12.248764 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.248739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:39:12.253680 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.253650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkq52\" (UniqueName: \"kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52\") pod \"authorino-776b54f7d9-bmrrv\" (UID: \"319fe903-dc66-454b-9cd5-9264d1a85499\") " pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:12.354631 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.354578 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqzgq\" (UniqueName: \"kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq\") pod \"a411afc4-9efe-4da9-b517-c630e3ac61ae\" (UID: \"a411afc4-9efe-4da9-b517-c630e3ac61ae\") " Jun 11 19:39:12.354825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.354724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5p6p\" (UniqueName: \"kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.354825 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.354805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq52\" (UniqueName: \"kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52\") pod \"authorino-776b54f7d9-bmrrv\" (UID: \"319fe903-dc66-454b-9cd5-9264d1a85499\") " pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:12.354950 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.354858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.356947 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.356921 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq" (OuterVolumeSpecName: "kube-api-access-kqzgq") pod "a411afc4-9efe-4da9-b517-c630e3ac61ae" (UID: "a411afc4-9efe-4da9-b517-c630e3ac61ae"). InnerVolumeSpecName "kube-api-access-kqzgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:39:12.362664 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.362634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkq52\" (UniqueName: \"kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52\") pod \"authorino-776b54f7d9-bmrrv\" (UID: \"319fe903-dc66-454b-9cd5-9264d1a85499\") " pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:12.455700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.455597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.455700 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.455652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5p6p\" (UniqueName: \"kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.455953 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.455710 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqzgq\" (UniqueName: \"kubernetes.io/projected/a411afc4-9efe-4da9-b517-c630e3ac61ae-kube-api-access-kqzgq\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:39:12.458349 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.458322 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.464500 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.464474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5p6p\" (UniqueName: \"kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p\") pod \"authorino-778bfff497-grflz\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.547941 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.547907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:39:12.693021 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:12.692990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:39:12.694372 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:39:12.694346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e62eef7_2a11_41de_bddf_8500bc945cdd.slice/crio-f250445ed64adbcbe5043d6baf29fb1f72aff8b4b393697fde44770178ebe41e WatchSource:0}: Error finding container f250445ed64adbcbe5043d6baf29fb1f72aff8b4b393697fde44770178ebe41e: Status 404 returned error can't find the container with id f250445ed64adbcbe5043d6baf29fb1f72aff8b4b393697fde44770178ebe41e Jun 11 19:39:13.208320 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.208278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778bfff497-grflz" event={"ID":"6e62eef7-2a11-41de-bddf-8500bc945cdd","Type":"ContainerStarted","Data":"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b"} Jun 11 19:39:13.208813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.208336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778bfff497-grflz" event={"ID":"6e62eef7-2a11-41de-bddf-8500bc945cdd","Type":"ContainerStarted","Data":"f250445ed64adbcbe5043d6baf29fb1f72aff8b4b393697fde44770178ebe41e"} Jun 11 19:39:13.208813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.208342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:13.208813 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.208594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6hsnj" Jun 11 19:39:13.216248 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.216219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:13.226770 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.226714 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-778bfff497-grflz" podStartSLOduration=0.856597836 podStartE2EDuration="1.226696989s" totalImagesPullingTime="370.099153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:13.22449394 +0000 UTC m=+771.276279004" watchObservedRunningTime="2026-06-11 19:39:13.226696989 +0000 UTC m=+771.278482027" Jun 11 19:39:13.249336 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.249295 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6hsnj"] Jun 11 19:39:13.254403 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.254369 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6hsnj"] Jun 11 19:39:13.258516 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.258478 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:39:13.258736 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.258704 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tz4dj" podUID="5973b686-34b9-4e72-a8a0-d900aea41904" containerName="authorino" containerID="cri-o://3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899" gracePeriod=30 Jun 11 19:39:13.363872 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.363839 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkq52\" (UniqueName: \"kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52\") pod \"319fe903-dc66-454b-9cd5-9264d1a85499\" (UID: \"319fe903-dc66-454b-9cd5-9264d1a85499\") " Jun 11 19:39:13.366153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.366125 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52" (OuterVolumeSpecName: "kube-api-access-pkq52") pod "319fe903-dc66-454b-9cd5-9264d1a85499" (UID: "319fe903-dc66-454b-9cd5-9264d1a85499"). InnerVolumeSpecName "kube-api-access-pkq52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:39:13.465321 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.465292 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkq52\" (UniqueName: \"kubernetes.io/projected/319fe903-dc66-454b-9cd5-9264d1a85499-kube-api-access-pkq52\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:39:13.505925 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.505899 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:39:13.667799 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.667688 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7zgd\" (UniqueName: \"kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd\") pod \"5973b686-34b9-4e72-a8a0-d900aea41904\" (UID: \"5973b686-34b9-4e72-a8a0-d900aea41904\") " Jun 11 19:39:13.670207 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.670171 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd" (OuterVolumeSpecName: "kube-api-access-n7zgd") pod "5973b686-34b9-4e72-a8a0-d900aea41904" (UID: "5973b686-34b9-4e72-a8a0-d900aea41904"). InnerVolumeSpecName "kube-api-access-n7zgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:39:13.769043 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:13.769009 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7zgd\" (UniqueName: \"kubernetes.io/projected/5973b686-34b9-4e72-a8a0-d900aea41904-kube-api-access-n7zgd\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:39:14.215849 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.215812 2581 generic.go:356] "Generic (PLEG): container finished" podID="5973b686-34b9-4e72-a8a0-d900aea41904" containerID="3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899" exitCode=0 Jun 11 19:39:14.216307 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.215886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tz4dj" event={"ID":"5973b686-34b9-4e72-a8a0-d900aea41904","Type":"ContainerDied","Data":"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899"} Jun 11 19:39:14.216307 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.215903 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tz4dj" Jun 11 19:39:14.216307 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.215927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tz4dj" event={"ID":"5973b686-34b9-4e72-a8a0-d900aea41904","Type":"ContainerDied","Data":"dd4c05987b080e285545e137caecfdd54ca48df034ef6832b2a1575c304d4764"} Jun 11 19:39:14.216307 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.215946 2581 scope.go:117] "RemoveContainer" containerID="3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899" Jun 11 19:39:14.216307 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.216144 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-776b54f7d9-bmrrv" Jun 11 19:39:14.226964 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.226944 2581 scope.go:117] "RemoveContainer" containerID="3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899" Jun 11 19:39:14.227264 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:39:14.227249 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899\": container with ID starting with 3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899 not found: ID does not exist" containerID="3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899" Jun 11 19:39:14.227317 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.227272 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899"} err="failed to get container status \"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899\": rpc error: code = NotFound desc = could not find container \"3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899\": container with ID starting with 3523d740b8e0c6ed6a2b8d739bbdd9e2d3463fe1a1cd216c09b2c842c28a3899 not found: ID does not exist" Jun 11 19:39:14.246478 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.246446 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-776b54f7d9-bmrrv"] Jun 11 19:39:14.249602 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.249568 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-776b54f7d9-bmrrv"] Jun 11 19:39:14.260909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.260858 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:39:14.264590 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.264558 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tz4dj"] Jun 11 19:39:14.379768 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.379729 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319fe903-dc66-454b-9cd5-9264d1a85499" path="/var/lib/kubelet/pods/319fe903-dc66-454b-9cd5-9264d1a85499/volumes" Jun 11 19:39:14.379998 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.379984 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5973b686-34b9-4e72-a8a0-d900aea41904" path="/var/lib/kubelet/pods/5973b686-34b9-4e72-a8a0-d900aea41904/volumes" Jun 11 19:39:14.380285 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:14.380273 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a411afc4-9efe-4da9-b517-c630e3ac61ae" path="/var/lib/kubelet/pods/a411afc4-9efe-4da9-b517-c630e3ac61ae/volumes" Jun 11 19:39:16.752646 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:16.752604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:16.866388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:16.866339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:16.960358 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:16.960304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:19.559455 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:19.559416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:19.662163 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:19.662125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:48.566533 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:48.566498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:48.921787 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:48.921717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:49.022534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:49.022504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:49.126079 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:49.126036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:49.281076 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:49.280975 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:39:50.531195 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:39:50.531156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:17.629580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:40:17.629543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:54.395120 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:40:54.395084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:54.496003 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:40:54.495967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:22.427407 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:22.427368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:41:22.442549 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:22.442516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:41:34.830657 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:34.830618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:35.875567 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:35.875529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:39.878397 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:39.878355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:39.979958 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:41:39.979916 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:42:03.474078 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:03.474031 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:03.474630 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:03.474253 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" containerID="cri-o://b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019" gracePeriod=30 Jun 11 19:42:05.130823 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.130796 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.220763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.220663 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerID="b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019" exitCode=143 Jun 11 19:42:05.220763 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.220709 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.221035 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.220754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfcfaccb-e606-47ce-9ce6-89951ed0585c","Type":"ContainerDied","Data":"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019"} Jun 11 19:42:05.221035 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.220812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfcfaccb-e606-47ce-9ce6-89951ed0585c","Type":"ContainerDied","Data":"3a8b7d63a4df4e74e5037ff23b43a4855cdb5841b45be212dad6c6d0edb2a9a2"} Jun 11 19:42:05.221035 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.220841 2581 scope.go:117] "RemoveContainer" containerID="b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019" Jun 11 19:42:05.224149 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.224128 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2q9n\" (UniqueName: \"kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n\") pod \"dfcfaccb-e606-47ce-9ce6-89951ed0585c\" (UID: \"dfcfaccb-e606-47ce-9ce6-89951ed0585c\") " Jun 11 19:42:05.226431 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.226402 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n" (OuterVolumeSpecName: "kube-api-access-m2q9n") pod "dfcfaccb-e606-47ce-9ce6-89951ed0585c" (UID: "dfcfaccb-e606-47ce-9ce6-89951ed0585c"). InnerVolumeSpecName "kube-api-access-m2q9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:42:05.231166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.231142 2581 scope.go:117] "RemoveContainer" containerID="b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019" Jun 11 19:42:05.231481 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:42:05.231457 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019\": container with ID starting with b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019 not found: ID does not exist" containerID="b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019" Jun 11 19:42:05.231541 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.231491 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019"} err="failed to get container status \"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019\": rpc error: code = NotFound desc = could not find container \"b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019\": container with ID starting with b6d24c65fd1300fa27b4d39ff5e2aa60afa7ca795c40b5d1db9d580253c6b019 not found: ID does not exist" Jun 11 19:42:05.325174 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.325118 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2q9n\" (UniqueName: \"kubernetes.io/projected/dfcfaccb-e606-47ce-9ce6-89951ed0585c-kube-api-access-m2q9n\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:42:05.543221 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.543182 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:05.549458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.549426 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:05.574790 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.574753 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:05.575153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575137 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5973b686-34b9-4e72-a8a0-d900aea41904" containerName="authorino" Jun 11 19:42:05.575153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575152 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5973b686-34b9-4e72-a8a0-d900aea41904" containerName="authorino" Jun 11 19:42:05.575312 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575181 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" Jun 11 19:42:05.575312 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575188 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" Jun 11 19:42:05.575312 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575243 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" containerName="keycloak" Jun 11 19:42:05.575312 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.575255 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5973b686-34b9-4e72-a8a0-d900aea41904" containerName="authorino" Jun 11 19:42:05.579626 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.579608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.582215 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.582190 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 19:42:05.582329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.582200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 19:42:05.582329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.582222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tvj5h\"" Jun 11 19:42:05.582329 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.582225 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 19:42:05.582499 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.582374 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 19:42:05.587926 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.587904 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:05.729751 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.729709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx2t4\" (UniqueName: \"kubernetes.io/projected/66607aeb-69e3-4403-8ea1-e094c8b60caa-kube-api-access-qx2t4\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.729955 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.729773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66607aeb-69e3-4403-8ea1-e094c8b60caa-test-realms\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.831306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.831224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx2t4\" (UniqueName: \"kubernetes.io/projected/66607aeb-69e3-4403-8ea1-e094c8b60caa-kube-api-access-qx2t4\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.831306 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.831280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66607aeb-69e3-4403-8ea1-e094c8b60caa-test-realms\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.831958 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.831937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66607aeb-69e3-4403-8ea1-e094c8b60caa-test-realms\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.839575 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.839546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx2t4\" (UniqueName: \"kubernetes.io/projected/66607aeb-69e3-4403-8ea1-e094c8b60caa-kube-api-access-qx2t4\") pod \"maas-keycloak-0\" (UID: \"66607aeb-69e3-4403-8ea1-e094c8b60caa\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:05.890337 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:05.890296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:06.034677 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:06.034644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:42:06.035721 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:42:06.035682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66607aeb_69e3_4403_8ea1_e094c8b60caa.slice/crio-eac0db6e2a593785d77687da1fefa5e9e72844904a75dd6751d9b7c90b7f5a8a WatchSource:0}: Error finding container eac0db6e2a593785d77687da1fefa5e9e72844904a75dd6751d9b7c90b7f5a8a: Status 404 returned error can't find the container with id eac0db6e2a593785d77687da1fefa5e9e72844904a75dd6751d9b7c90b7f5a8a Jun 11 19:42:06.236137 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:06.236092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66607aeb-69e3-4403-8ea1-e094c8b60caa","Type":"ContainerStarted","Data":"eac0db6e2a593785d77687da1fefa5e9e72844904a75dd6751d9b7c90b7f5a8a"} Jun 11 19:42:06.379478 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:06.379444 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfcfaccb-e606-47ce-9ce6-89951ed0585c" path="/var/lib/kubelet/pods/dfcfaccb-e606-47ce-9ce6-89951ed0585c/volumes" Jun 11 19:42:07.244639 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:07.244596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66607aeb-69e3-4403-8ea1-e094c8b60caa","Type":"ContainerStarted","Data":"4482756903bf3afd75d13d790cfc9d85fdd1b0b2c0d347b8edb6cd028fde12b5"} Jun 11 19:42:07.262766 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:07.262692 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.930196997 podStartE2EDuration="2.262667791s" totalImagesPullingTime="332.470794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:42:07.261312398 +0000 UTC m=+945.313097460" watchObservedRunningTime="2026-06-11 19:42:07.262667791 +0000 UTC m=+945.314452858" Jun 11 19:42:07.890716 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:07.890665 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:07.892831 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:07.892789 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:08.891683 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:08.891624 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:09.891155 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:09.891103 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:10.891840 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:10.891787 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:11.891435 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:11.891377 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:12.891815 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:12.891758 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:13.891527 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:13.891470 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:14.890985 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:14.890929 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:15.891102 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:15.891058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:15.891717 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:15.891374 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:16.890998 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:16.890947 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:17.891267 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:17.891219 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:18.891742 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:18.891696 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:19.890887 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:19.890820 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 19:42:21.018115 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:21.018069 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:21.039551 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:21.039489 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="66607aeb-69e3-4403-8ea1-e094c8b60caa" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:42:31.025158 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:31.025120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:42:41.720054 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.720013 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cb6c4ddd5-rtt26"] Jun 11 19:42:41.725198 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.725168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:41.727608 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.727573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 19:42:41.730774 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.730745 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cb6c4ddd5-rtt26"] Jun 11 19:42:41.908755 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.908715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9388735c-43a0-497b-81ba-a1b57c7ccf8d-tls-cert\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:41.908969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.908769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ztlb\" (UniqueName: \"kubernetes.io/projected/9388735c-43a0-497b-81ba-a1b57c7ccf8d-kube-api-access-6ztlb\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:41.908969 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:41.908816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9388735c-43a0-497b-81ba-a1b57c7ccf8d-oidc-ca\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.010200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.010098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9388735c-43a0-497b-81ba-a1b57c7ccf8d-tls-cert\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.010200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.010159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ztlb\" (UniqueName: \"kubernetes.io/projected/9388735c-43a0-497b-81ba-a1b57c7ccf8d-kube-api-access-6ztlb\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.010200 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.010191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9388735c-43a0-497b-81ba-a1b57c7ccf8d-oidc-ca\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.010955 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.010926 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9388735c-43a0-497b-81ba-a1b57c7ccf8d-oidc-ca\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.012800 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.012767 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9388735c-43a0-497b-81ba-a1b57c7ccf8d-tls-cert\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.017770 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.017737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ztlb\" (UniqueName: \"kubernetes.io/projected/9388735c-43a0-497b-81ba-a1b57c7ccf8d-kube-api-access-6ztlb\") pod \"authorino-6cb6c4ddd5-rtt26\" (UID: \"9388735c-43a0-497b-81ba-a1b57c7ccf8d\") " pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.036740 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.036706 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" Jun 11 19:42:42.182376 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.182341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cb6c4ddd5-rtt26"] Jun 11 19:42:42.183242 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:42:42.183216 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9388735c_43a0_497b_81ba_a1b57c7ccf8d.slice/crio-7478272c7303aa2a419d6831fb4d4d7bce0ae6354d73a52733be1eca7f3e0d0b WatchSource:0}: Error finding container 7478272c7303aa2a419d6831fb4d4d7bce0ae6354d73a52733be1eca7f3e0d0b: Status 404 returned error can't find the container with id 7478272c7303aa2a419d6831fb4d4d7bce0ae6354d73a52733be1eca7f3e0d0b Jun 11 19:42:42.515666 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:42.515628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" event={"ID":"9388735c-43a0-497b-81ba-a1b57c7ccf8d","Type":"ContainerStarted","Data":"7478272c7303aa2a419d6831fb4d4d7bce0ae6354d73a52733be1eca7f3e0d0b"} Jun 11 19:42:43.523482 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.523446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" event={"ID":"9388735c-43a0-497b-81ba-a1b57c7ccf8d","Type":"ContainerStarted","Data":"38bfbb69a8cff580a9ab9496d2cf1d81c16fc67d02eb390cbbbf5907611716d3"} Jun 11 19:42:43.540983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.540926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cb6c4ddd5-rtt26" podStartSLOduration=2.207830465 podStartE2EDuration="2.540906007s" totalImagesPullingTime="333.075542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:42:43.539231476 +0000 UTC m=+981.591016538" watchObservedRunningTime="2026-06-11 19:42:43.540906007 +0000 UTC m=+981.592691046" Jun 11 19:42:43.564152 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.564108 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:42:43.564364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.564331 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-778bfff497-grflz" podUID="6e62eef7-2a11-41de-bddf-8500bc945cdd" containerName="authorino" containerID="cri-o://c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b" gracePeriod=30 Jun 11 19:42:43.829828 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.829803 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:42:43.926257 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.926207 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5p6p\" (UniqueName: \"kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p\") pod \"6e62eef7-2a11-41de-bddf-8500bc945cdd\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " Jun 11 19:42:43.926437 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.926313 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert\") pod \"6e62eef7-2a11-41de-bddf-8500bc945cdd\" (UID: \"6e62eef7-2a11-41de-bddf-8500bc945cdd\") " Jun 11 19:42:43.928454 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.928420 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p" (OuterVolumeSpecName: "kube-api-access-t5p6p") pod "6e62eef7-2a11-41de-bddf-8500bc945cdd" (UID: "6e62eef7-2a11-41de-bddf-8500bc945cdd"). InnerVolumeSpecName "kube-api-access-t5p6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:42:43.938251 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:43.938219 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6e62eef7-2a11-41de-bddf-8500bc945cdd" (UID: "6e62eef7-2a11-41de-bddf-8500bc945cdd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:42:44.028043 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.028004 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5p6p\" (UniqueName: \"kubernetes.io/projected/6e62eef7-2a11-41de-bddf-8500bc945cdd-kube-api-access-t5p6p\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:42:44.028043 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.028038 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e62eef7-2a11-41de-bddf-8500bc945cdd-tls-cert\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:42:44.213979 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.213937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:42:44.289587 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.289546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:42:44.530719 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.530619 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e62eef7-2a11-41de-bddf-8500bc945cdd" containerID="c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b" exitCode=0 Jun 11 19:42:44.531123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.530758 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778bfff497-grflz" Jun 11 19:42:44.531123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.530762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778bfff497-grflz" event={"ID":"6e62eef7-2a11-41de-bddf-8500bc945cdd","Type":"ContainerDied","Data":"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b"} Jun 11 19:42:44.531123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.530825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778bfff497-grflz" event={"ID":"6e62eef7-2a11-41de-bddf-8500bc945cdd","Type":"ContainerDied","Data":"f250445ed64adbcbe5043d6baf29fb1f72aff8b4b393697fde44770178ebe41e"} Jun 11 19:42:44.531123 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.530855 2581 scope.go:117] "RemoveContainer" containerID="c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b" Jun 11 19:42:44.540400 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.540377 2581 scope.go:117] "RemoveContainer" containerID="c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b" Jun 11 19:42:44.540758 ip-10-0-130-228 kubenswrapper[2581]: E0611 19:42:44.540731 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b\": container with ID starting with c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b not found: ID does not exist" containerID="c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b" Jun 11 19:42:44.540808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.540768 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b"} err="failed to get container status \"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b\": rpc error: code = NotFound desc = could not find container \"c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b\": container with ID starting with c70608f4fae6f28e7d8955f25618edc5764bfd2aa3df2d0f9bfd33703d24eb5b not found: ID does not exist" Jun 11 19:42:44.546184 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.546110 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:42:44.549371 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:44.549345 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-778bfff497-grflz"] Jun 11 19:42:46.380331 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:46.380295 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e62eef7-2a11-41de-bddf-8500bc945cdd" path="/var/lib/kubelet/pods/6e62eef7-2a11-41de-bddf-8500bc945cdd/volumes" Jun 11 19:42:50.392295 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:50.392261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:42:50.799469 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:50.799363 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:42:53.177197 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:53.177155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:42:53.485189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:42:53.485085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:43:05.459176 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:05.459139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:06.083153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:06.083114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:43:12.624166 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:12.624123 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:12.724632 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:12.724593 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:24.774729 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:24.774690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:25.684989 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:25.684943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:43:28.982174 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:28.982134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:29.983878 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:29.983834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:43:56.539937 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:56.539896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:57.682628 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:43:57.682570 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pf5wj"] Jun 11 19:45:00.141891 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.141828 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-wzkxd"] Jun 11 19:45:00.142382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.142266 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e62eef7-2a11-41de-bddf-8500bc945cdd" containerName="authorino" Jun 11 19:45:00.142382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.142281 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e62eef7-2a11-41de-bddf-8500bc945cdd" containerName="authorino" Jun 11 19:45:00.142382 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.142358 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e62eef7-2a11-41de-bddf-8500bc945cdd" containerName="authorino" Jun 11 19:45:00.145580 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.145562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:00.147971 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.147947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6bhwc\"" Jun 11 19:45:00.152684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.152650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-wzkxd"] Jun 11 19:45:00.275660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.275618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbflh\" (UniqueName: \"kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh\") pod \"maas-api-key-cleanup-29686785-wzkxd\" (UID: \"7d0ab050-332c-4a4d-b904-673f4808762c\") " pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:00.376388 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.376351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbflh\" (UniqueName: \"kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh\") pod \"maas-api-key-cleanup-29686785-wzkxd\" (UID: \"7d0ab050-332c-4a4d-b904-673f4808762c\") " pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:00.384690 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.384660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbflh\" (UniqueName: \"kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh\") pod \"maas-api-key-cleanup-29686785-wzkxd\" (UID: \"7d0ab050-332c-4a4d-b904-673f4808762c\") " pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:00.458189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.458101 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:00.597845 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.597805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-wzkxd"] Jun 11 19:45:00.598777 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:45:00.598752 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0ab050_332c_4a4d_b904_673f4808762c.slice/crio-5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc WatchSource:0}: Error finding container 5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc: Status 404 returned error can't find the container with id 5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc Jun 11 19:45:00.600804 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:00.600784 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:45:01.325417 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:01.325377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" event={"ID":"7d0ab050-332c-4a4d-b904-673f4808762c","Type":"ContainerStarted","Data":"5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc"} Jun 11 19:45:03.339148 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:03.339102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" event={"ID":"7d0ab050-332c-4a4d-b904-673f4808762c","Type":"ContainerStarted","Data":"48ea9a7c5a5e76e2aa8bacfdf918349a6d20ff7e95c4636d5011ebaff4b50476"} Jun 11 19:45:03.354377 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:03.354319 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" podStartSLOduration=0.985958219 podStartE2EDuration="3.354300886s" totalImagesPullingTime="2.368342667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:45:03.352772714 +0000 UTC m=+1121.404557776" watchObservedRunningTime="2026-06-11 19:45:03.354300886 +0000 UTC m=+1121.406085984" Jun 11 19:45:04.347118 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:04.347081 2581 generic.go:356] "Generic (PLEG): container finished" podID="7d0ab050-332c-4a4d-b904-673f4808762c" containerID="48ea9a7c5a5e76e2aa8bacfdf918349a6d20ff7e95c4636d5011ebaff4b50476" exitCode=0 Jun 11 19:45:04.347530 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:04.347148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" event={"ID":"7d0ab050-332c-4a4d-b904-673f4808762c","Type":"ContainerDied","Data":"48ea9a7c5a5e76e2aa8bacfdf918349a6d20ff7e95c4636d5011ebaff4b50476"} Jun 11 19:45:05.495952 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:05.495923 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:05.527426 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:05.527389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbflh\" (UniqueName: \"kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh\") pod \"7d0ab050-332c-4a4d-b904-673f4808762c\" (UID: \"7d0ab050-332c-4a4d-b904-673f4808762c\") " Jun 11 19:45:05.529723 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:05.529686 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh" (OuterVolumeSpecName: "kube-api-access-fbflh") pod "7d0ab050-332c-4a4d-b904-673f4808762c" (UID: "7d0ab050-332c-4a4d-b904-673f4808762c"). InnerVolumeSpecName "kube-api-access-fbflh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:45:05.628177 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:05.628082 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbflh\" (UniqueName: \"kubernetes.io/projected/7d0ab050-332c-4a4d-b904-673f4808762c-kube-api-access-fbflh\") on node \"ip-10-0-130-228.ec2.internal\" DevicePath \"\"" Jun 11 19:45:06.360270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:06.360234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" event={"ID":"7d0ab050-332c-4a4d-b904-673f4808762c","Type":"ContainerDied","Data":"5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc"} Jun 11 19:45:06.360270 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:06.360264 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-wzkxd" Jun 11 19:45:06.360485 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:45:06.360316 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5558bdca7eac74dc24948d9dd490ef9acd53a0baccc0a9a673861ca736bb42cc" Jun 11 19:46:22.475648 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:46:22.475618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:46:22.487962 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:46:22.487937 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww7dt_57ce7edf-4c08-4045-ac74-657d10f3484e/ovn-acl-logging/0.log" Jun 11 19:47:48.103089 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:48.103051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cb6c4ddd5-rtt26_9388735c-43a0-497b-81ba-a1b57c7ccf8d/authorino/0.log" Jun 11 19:47:53.190682 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:53.190646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686785-wzkxd_7d0ab050-332c-4a4d-b904-673f4808762c/cleanup/0.log" Jun 11 19:47:53.905006 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:53.904971 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-qzrcr_d222da78-d017-4ad6-8d11-86659c584a79/copy-manifests/0.log" Jun 11 19:47:53.912582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:53.912557 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-qzrcr_d222da78-d017-4ad6-8d11-86659c584a79/manager/0.log" Jun 11 19:47:54.798249 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.798213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/extract/0.log" Jun 11 19:47:54.804423 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.804399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/util/0.log" Jun 11 19:47:54.810823 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.810798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/pull/0.log" Jun 11 19:47:54.937020 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.936984 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/util/0.log" Jun 11 19:47:54.943642 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.943608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/pull/0.log" Jun 11 19:47:54.949977 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:54.949954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/extract/0.log" Jun 11 19:47:55.056413 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.056329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/util/0.log" Jun 11 19:47:55.062291 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.062231 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/pull/0.log" Jun 11 19:47:55.068356 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.068326 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/extract/0.log" Jun 11 19:47:55.177708 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.177666 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/pull/0.log" Jun 11 19:47:55.183880 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.183842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/extract/0.log" Jun 11 19:47:55.189808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.189779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/util/0.log" Jun 11 19:47:55.304493 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.304461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cb6c4ddd5-rtt26_9388735c-43a0-497b-81ba-a1b57c7ccf8d/authorino/0.log" Jun 11 19:47:55.640205 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.640179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rwrfr_3bb1c615-542a-4a48-9d4d-4fb6c64bceef/kuadrant-console-plugin/0.log" Jun 11 19:47:55.989909 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:55.989784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pf5wj_b2cbfe2c-71b9-4d0e-b81e-4cbf80715062/limitador/0.log" Jun 11 19:47:56.684983 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:47:56.684956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-2hb5n_2b2d75e6-cf31-4886-85e6-27dc629404ea/kube-auth-proxy/0.log" Jun 11 19:48:02.368647 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.368605 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hwgs/must-gather-2qhgr"] Jun 11 19:48:02.369080 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.369024 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0ab050-332c-4a4d-b904-673f4808762c" containerName="cleanup" Jun 11 19:48:02.369080 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.369036 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0ab050-332c-4a4d-b904-673f4808762c" containerName="cleanup" Jun 11 19:48:02.369154 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.369106 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d0ab050-332c-4a4d-b904-673f4808762c" containerName="cleanup" Jun 11 19:48:02.372509 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.372475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.374790 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.374761 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hwgs\"/\"openshift-service-ca.crt\"" Jun 11 19:48:02.374952 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.374810 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hwgs\"/\"kube-root-ca.crt\"" Jun 11 19:48:02.375590 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.375568 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hwgs\"/\"default-dockercfg-g8n5m\"" Jun 11 19:48:02.382850 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.382804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:48:02.388146 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.388114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/must-gather-2qhgr"] Jun 11 19:48:02.563153 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.563095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd62f076-47ca-4350-bb74-cb1a4b38ae26-must-gather-output\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.563348 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.563173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47vlz\" (UniqueName: \"kubernetes.io/projected/fd62f076-47ca-4350-bb74-cb1a4b38ae26-kube-api-access-47vlz\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.664689 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.664565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd62f076-47ca-4350-bb74-cb1a4b38ae26-must-gather-output\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.664689 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.664631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47vlz\" (UniqueName: \"kubernetes.io/projected/fd62f076-47ca-4350-bb74-cb1a4b38ae26-kube-api-access-47vlz\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.664991 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.664973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd62f076-47ca-4350-bb74-cb1a4b38ae26-must-gather-output\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.686080 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.686041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47vlz\" (UniqueName: \"kubernetes.io/projected/fd62f076-47ca-4350-bb74-cb1a4b38ae26-kube-api-access-47vlz\") pod \"must-gather-2qhgr\" (UID: \"fd62f076-47ca-4350-bb74-cb1a4b38ae26\") " pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:02.984319 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:02.984217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" Jun 11 19:48:03.133994 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:03.133955 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/must-gather-2qhgr"] Jun 11 19:48:03.135260 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:48:03.135234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd62f076_47ca_4350_bb74_cb1a4b38ae26.slice/crio-7ca9534094bd87866ebde0dc7cb096e689e76052203bd3b881b94eac70642869 WatchSource:0}: Error finding container 7ca9534094bd87866ebde0dc7cb096e689e76052203bd3b881b94eac70642869: Status 404 returned error can't find the container with id 7ca9534094bd87866ebde0dc7cb096e689e76052203bd3b881b94eac70642869 Jun 11 19:48:03.385918 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:03.385882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" event={"ID":"fd62f076-47ca-4350-bb74-cb1a4b38ae26","Type":"ContainerStarted","Data":"7ca9534094bd87866ebde0dc7cb096e689e76052203bd3b881b94eac70642869"} Jun 11 19:48:03.497263 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:03.497225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" limit=1024 Jun 11 19:48:04.409782 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:04.409741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" event={"ID":"fd62f076-47ca-4350-bb74-cb1a4b38ae26","Type":"ContainerStarted","Data":"028bbc1493beb0e42ec91ce1a0c83bedf3e61c64bbcad9777a8d4852ebbf534a"} Jun 11 19:48:04.410410 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:04.410365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" event={"ID":"fd62f076-47ca-4350-bb74-cb1a4b38ae26","Type":"ContainerStarted","Data":"50460024832d6f2f5efa54ba985b04252abc2b686cdc100cc081db42edc7bf39"} Jun 11 19:48:04.430061 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:04.429967 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hwgs/must-gather-2qhgr" podStartSLOduration=1.596939124 podStartE2EDuration="2.429946119s" totalImagesPullingTime="833.006995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:48:04.42532188 +0000 UTC m=+1302.477106941" watchObservedRunningTime="2026-06-11 19:48:04.429946119 +0000 UTC m=+1302.481731183" Jun 11 19:48:05.603618 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:05.603584 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9hplq_74716a10-825f-4bd5-8d4a-59fcceccaa7a/global-pull-secret-syncer/0.log" Jun 11 19:48:05.731145 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:05.731110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9t99q_7c828eda-3cbd-42a8-99f1-5527a6bff9b4/konnectivity-agent/0.log" Jun 11 19:48:05.808230 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:05.808197 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-228.ec2.internal_1b616c8523a04a6fccd77daac93baa70/haproxy/0.log" Jun 11 19:48:10.468977 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.468943 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/extract/0.log" Jun 11 19:48:10.497231 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.497201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/util/0.log" Jun 11 19:48:10.529028 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.528992 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pv8mf_439c227b-3025-4143-a37d-ed8b3d00f4a9/pull/0.log" Jun 11 19:48:10.553906 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.553835 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/extract/0.log" Jun 11 19:48:10.596403 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.596364 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/util/0.log" Jun 11 19:48:10.623951 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.623917 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h9tbb_3e5bb90e-5794-4bda-aa82-7d3826f38f55/pull/0.log" Jun 11 19:48:10.680485 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.680436 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/extract/0.log" Jun 11 19:48:10.705726 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.705696 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/util/0.log" Jun 11 19:48:10.733484 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.733396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73442nh_06319ebc-6866-4f24-99c3-9dec59ff748b/pull/0.log" Jun 11 19:48:10.772206 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.772170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/extract/0.log" Jun 11 19:48:10.799534 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.799502 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/util/0.log" Jun 11 19:48:10.823144 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.823088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nrk9q_72876fdc-6930-4238-9e4f-6b3a27c64760/pull/0.log" Jun 11 19:48:10.856935 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.856857 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cb6c4ddd5-rtt26_9388735c-43a0-497b-81ba-a1b57c7ccf8d/authorino/0.log" Jun 11 19:48:10.971064 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:10.971035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rwrfr_3bb1c615-542a-4a48-9d4d-4fb6c64bceef/kuadrant-console-plugin/0.log" Jun 11 19:48:11.081442 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:11.081347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pf5wj_b2cbfe2c-71b9-4d0e-b81e-4cbf80715062/limitador/0.log" Jun 11 19:48:12.857159 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.857128 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/alertmanager/0.log" Jun 11 19:48:12.887205 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.887174 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/config-reloader/0.log" Jun 11 19:48:12.910960 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.910920 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/kube-rbac-proxy-web/0.log" Jun 11 19:48:12.934929 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.934897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/kube-rbac-proxy/0.log" Jun 11 19:48:12.957669 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.957636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/kube-rbac-proxy-metric/0.log" Jun 11 19:48:12.980274 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:12.980238 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/prom-label-proxy/0.log" Jun 11 19:48:13.008515 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.008478 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f9b3d0f0-34e9-405f-aed6-4b9b886c2984/init-config-reloader/0.log" Jun 11 19:48:13.047222 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.047182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-vqcqd_93cfc19f-5061-4cee-b0e1-81844f260f23/cluster-monitoring-operator/0.log" Jun 11 19:48:13.076822 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.076780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qllf_f530177d-1a21-4bd1-b8aa-82fe0e06d507/kube-state-metrics/0.log" Jun 11 19:48:13.098278 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.098246 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qllf_f530177d-1a21-4bd1-b8aa-82fe0e06d507/kube-rbac-proxy-main/0.log" Jun 11 19:48:13.130581 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.130493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qllf_f530177d-1a21-4bd1-b8aa-82fe0e06d507/kube-rbac-proxy-self/0.log" Jun 11 19:48:13.160653 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.160627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-688d6b77d6-bqmjk_49e5e6a6-b0d7-449b-898a-ee8665d8617a/metrics-server/0.log" Jun 11 19:48:13.189732 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.189706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-59kcc_8d932368-4b73-4add-90ae-c91ebb33dc35/monitoring-plugin/0.log" Jun 11 19:48:13.297582 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.297554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jk22j_d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e/node-exporter/0.log" Jun 11 19:48:13.328186 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.328142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jk22j_d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e/kube-rbac-proxy/0.log" Jun 11 19:48:13.350925 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.350896 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jk22j_d2bcbd89-1ce6-4e0c-b135-99bcd68fb46e/init-textfile/0.log" Jun 11 19:48:13.812963 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.812933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-phpx4_0fc23933-b101-4561-bada-4b0a4ebfb2ca/prometheus-operator-admission-webhook/0.log" Jun 11 19:48:13.847364 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.847335 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97bf85f6f-q647c_73ec8532-ea0a-42f5-971e-35491684e660/telemeter-client/0.log" Jun 11 19:48:13.877687 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.877009 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97bf85f6f-q647c_73ec8532-ea0a-42f5-971e-35491684e660/reload/0.log" Jun 11 19:48:13.925385 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.925347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97bf85f6f-q647c_73ec8532-ea0a-42f5-971e-35491684e660/kube-rbac-proxy/0.log" Jun 11 19:48:13.971803 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.971766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/thanos-query/0.log" Jun 11 19:48:13.997766 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:13.997724 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/kube-rbac-proxy-web/0.log" Jun 11 19:48:14.021147 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:14.021056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/kube-rbac-proxy/0.log" Jun 11 19:48:14.043247 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:14.043217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/prom-label-proxy/0.log" Jun 11 19:48:14.065998 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:14.065954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/kube-rbac-proxy-rules/0.log" Jun 11 19:48:14.088481 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:14.088445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb6798fc8-dj2m6_da52b9e1-09bc-4a6b-955a-59871c90a289/kube-rbac-proxy-metrics/0.log" Jun 11 19:48:16.409608 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.409564 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7"] Jun 11 19:48:16.416858 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.416814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.421600 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.421566 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7"] Jun 11 19:48:16.510277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.510239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-sys\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.510277 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.510279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29g74\" (UniqueName: \"kubernetes.io/projected/34b5f857-0827-424d-980e-4a73a905b1d0-kube-api-access-29g74\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.510561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.510308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-proc\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.510561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.510340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-lib-modules\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.510561 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.510356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-podres\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.610848 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.610804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-sys\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.611151 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.611125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29g74\" (UniqueName: \"kubernetes.io/projected/34b5f857-0827-424d-980e-4a73a905b1d0-kube-api-access-29g74\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.611660 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.611634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-proc\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612027 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.612005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-lib-modules\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612290 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.612275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-podres\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612494 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.612242 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-lib-modules\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612610 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.611929 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-proc\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612699 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.610988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-sys\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.612925 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.612905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34b5f857-0827-424d-980e-4a73a905b1d0-podres\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.620442 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.620409 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29g74\" (UniqueName: \"kubernetes.io/projected/34b5f857-0827-424d-980e-4a73a905b1d0-kube-api-access-29g74\") pod \"perf-node-gather-daemonset-hxzj7\" (UID: \"34b5f857-0827-424d-980e-4a73a905b1d0\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.717972 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.717891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bff7c8f8f-tbnvm_329df90e-f41b-47a3-ad61-b1c99f7d1ed9/console/0.log" Jun 11 19:48:16.732520 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.732487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:16.944777 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:16.944745 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7"] Jun 11 19:48:16.945572 ip-10-0-130-228 kubenswrapper[2581]: W0611 19:48:16.945545 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34b5f857_0827_424d_980e_4a73a905b1d0.slice/crio-ed3efddd2032aa59dfff3588e8512be270a15f352758f495bd6a10cacc8cb8ef WatchSource:0}: Error finding container ed3efddd2032aa59dfff3588e8512be270a15f352758f495bd6a10cacc8cb8ef: Status 404 returned error can't find the container with id ed3efddd2032aa59dfff3588e8512be270a15f352758f495bd6a10cacc8cb8ef Jun 11 19:48:17.535295 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:17.535251 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" event={"ID":"34b5f857-0827-424d-980e-4a73a905b1d0","Type":"ContainerStarted","Data":"2f2784f17c2885d69ee1e455fee82ef16f45d314d8cd51906cc2ff07318598ce"} Jun 11 19:48:17.535820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:17.535357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" event={"ID":"34b5f857-0827-424d-980e-4a73a905b1d0","Type":"ContainerStarted","Data":"ed3efddd2032aa59dfff3588e8512be270a15f352758f495bd6a10cacc8cb8ef"} Jun 11 19:48:17.535820 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:17.535605 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:17.550910 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:17.550823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" podStartSLOduration=1.5508006490000001 podStartE2EDuration="1.550800649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:48:17.549833249 +0000 UTC m=+1315.601618312" watchObservedRunningTime="2026-06-11 19:48:17.550800649 +0000 UTC m=+1315.602585712" Jun 11 19:48:18.663316 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:18.663276 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tjqf_149b0712-e3b7-4ee7-ad7a-a931c159ac4c/dns/0.log" Jun 11 19:48:18.687189 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:18.687157 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tjqf_149b0712-e3b7-4ee7-ad7a-a931c159ac4c/kube-rbac-proxy/0.log" Jun 11 19:48:18.832421 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:18.832391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm92m_1b8c22b3-6421-4f25-9a9d-26978fd434e3/dns-node-resolver/0.log" Jun 11 19:48:19.469116 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:19.469081 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p872s_15308ac6-f899-48b1-88dd-86de014005fe/node-ca/0.log" Jun 11 19:48:20.523937 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:20.523903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-2hb5n_2b2d75e6-cf31-4886-85e6-27dc629404ea/kube-auth-proxy/0.log" Jun 11 19:48:21.326185 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:21.326155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gb7cx_23ff1f2a-4c3b-4c93-a951-b8508c0be0b2/serve-healthcheck-canary/0.log" Jun 11 19:48:21.880060 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:21.880017 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-h7br9_fd123e75-a069-4b76-ad65-5dcb9ab4ede0/insights-operator/0.log" Jun 11 19:48:21.880808 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:21.880786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-h7br9_fd123e75-a069-4b76-ad65-5dcb9ab4ede0/insights-operator/1.log" Jun 11 19:48:22.060119 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:22.060090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntgtt_53635d4a-6373-4825-9b5d-0e548923d7c3/kube-rbac-proxy/0.log" Jun 11 19:48:22.119920 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:22.119888 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntgtt_53635d4a-6373-4825-9b5d-0e548923d7c3/exporter/0.log" Jun 11 19:48:22.155238 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:22.155142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntgtt_53635d4a-6373-4825-9b5d-0e548923d7c3/extractor/0.log" Jun 11 19:48:23.559510 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:23.559472 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-hxzj7" Jun 11 19:48:24.532625 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:24.532596 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686785-wzkxd_7d0ab050-332c-4a4d-b904-673f4808762c/cleanup/0.log" Jun 11 19:48:24.828458 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:24.828369 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-qzrcr_d222da78-d017-4ad6-8d11-86659c584a79/manager/0.log" Jun 11 19:48:24.850115 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:24.850051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-qzrcr_d222da78-d017-4ad6-8d11-86659c584a79/copy-manifests/0.log" Jun 11 19:48:26.731186 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:26.731146 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fb68f47b6-n9hbc_826c1a96-3fb0-47ba-9da5-34a5d52c1f47/manager/0.log" Jun 11 19:48:26.787951 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:26.787919 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-94fcd_ecce15bf-5a65-4e11-a8af-792b326f55b3/openshift-lws-operator/0.log" Jun 11 19:48:31.759964 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:31.759930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-2hb5n_2b2d75e6-cf31-4886-85e6-27dc629404ea/kube-auth-proxy/0.log" Jun 11 19:48:32.497016 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:32.496970 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-m9bfs_f640bdfa-03dd-463d-b644-3c5e206abe57/kube-storage-version-migrator-operator/1.log" Jun 11 19:48:32.499048 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:32.499022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-m9bfs_f640bdfa-03dd-463d-b644-3c5e206abe57/kube-storage-version-migrator-operator/0.log" Jun 11 19:48:33.029618 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.029583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-2hb5n_2b2d75e6-cf31-4886-85e6-27dc629404ea/kube-auth-proxy/0.log" Jun 11 19:48:33.802012 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.801979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/kube-multus-additional-cni-plugins/0.log" Jun 11 19:48:33.825215 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.825182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/egress-router-binary-copy/0.log" Jun 11 19:48:33.846758 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.846726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/cni-plugins/0.log" Jun 11 19:48:33.867565 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.867535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/bond-cni-plugin/0.log" Jun 11 19:48:33.889159 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.889122 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/routeoverride-cni/0.log" Jun 11 19:48:33.912387 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.912360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/whereabouts-cni-bincopy/0.log" Jun 11 19:48:33.934684 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:33.934653 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rlk5n_9dd8d9eb-fd03-400a-94d8-5334fc3ef322/whereabouts-cni/0.log" Jun 11 19:48:34.192368 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:34.192325 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mwbbg_70ea44d8-8a55-4626-9719-26e3dabd4cd1/kube-multus/0.log" Jun 11 19:48:34.214671 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:34.214634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tbdd_61acf913-396c-41e9-9073-e13bb414c6fa/network-metrics-daemon/0.log" Jun 11 19:48:34.233357 ip-10-0-130-228 kubenswrapper[2581]: I0611 19:48:34.233326 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tbdd_61acf913-396c-41e9-9073-e13bb414c6fa/kube-rbac-proxy/0.log"