Jun 10 00:35:15.612871 ip-10-0-140-158 systemd[1]: Starting Kubernetes Kubelet... Jun 10 00:35:16.078364 ip-10-0-140-158 kubenswrapper[2521]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:16.078364 ip-10-0-140-158 kubenswrapper[2521]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 00:35:16.078364 ip-10-0-140-158 kubenswrapper[2521]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:16.078364 ip-10-0-140-158 kubenswrapper[2521]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 00:35:16.078364 ip-10-0-140-158 kubenswrapper[2521]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:16.079093 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.078385 2521 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086399 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086422 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086428 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086448 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086455 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.086448 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086459 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086464 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086468 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086472 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086478 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086484 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086489 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086493 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086497 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086501 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086505 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086508 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086512 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086516 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086520 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086523 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086527 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086532 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086537 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.086802 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086541 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086546 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086552 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086555 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086560 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086564 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086569 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086573 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086577 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086581 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086585 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086589 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086594 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086598 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086603 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086609 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086613 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086617 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086622 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086627 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.087594 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086631 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086635 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086639 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086643 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086648 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086652 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086658 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086662 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086666 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086671 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086675 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086679 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086683 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086687 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086691 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086695 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086699 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086703 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086708 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086712 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.088090 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086716 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086722 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086727 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086731 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086735 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086740 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086745 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086750 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086754 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086758 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086762 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086766 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086770 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086774 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086779 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086783 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086787 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086791 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086796 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086802 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.088800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086806 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086812 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086818 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086822 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086826 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086830 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086835 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086839 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086843 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086848 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086852 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086856 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086860 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086903 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.086910 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089145 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089158 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089164 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089168 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.089669 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089173 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089177 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089181 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089185 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089193 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089200 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089204 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089208 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089213 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089217 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089222 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089226 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089230 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089235 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089239 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089244 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089249 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089253 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089257 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.090473 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089264 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089270 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089274 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089279 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089284 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089289 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089293 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089298 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089303 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089307 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089311 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089315 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089320 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089324 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089329 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089333 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089337 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089342 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089347 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089351 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.091305 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089355 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089360 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089365 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089370 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089375 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089379 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089383 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089388 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089393 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089397 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089402 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089406 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089410 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089414 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089419 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089423 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089427 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089431 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089453 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.092219 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089458 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089463 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089467 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089471 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089476 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089480 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089484 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089489 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089493 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089497 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089501 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089505 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089509 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089516 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089520 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089524 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089529 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089533 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089537 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089542 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.092833 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089547 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089552 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089556 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089561 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089566 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089570 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089574 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089579 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089583 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089588 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089592 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089596 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089601 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089606 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089612 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089618 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.089623 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090250 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090259 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090264 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.093510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090269 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090273 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090277 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090281 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090285 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090290 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090293 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090298 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090303 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090307 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090312 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090316 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090320 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090335 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090341 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090345 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090350 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090354 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090358 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090362 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.094044 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090366 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090371 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090375 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090379 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090384 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090388 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090393 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090397 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090401 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090405 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090409 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090414 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090421 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090427 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090432 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090455 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090459 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090464 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090469 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090473 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.094754 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090478 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090482 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090486 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090491 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090495 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090499 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090512 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090518 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090523 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090528 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090535 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090540 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090544 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090551 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090555 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090559 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090564 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090569 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090573 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.095279 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090577 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090581 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090586 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090590 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090594 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090598 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090603 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090607 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090611 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090616 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090620 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090624 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090628 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090632 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090636 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090641 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090651 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090657 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090661 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090665 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.095767 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090676 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090682 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090686 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090691 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090695 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090699 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090704 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090708 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090712 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090716 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090721 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090725 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090730 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090734 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090738 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090743 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.090747 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090856 2521 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090868 2521 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090877 2521 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 00:35:16.096345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090884 2521 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090894 2521 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090900 2521 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090907 2521 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090914 2521 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090919 2521 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090924 2521 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090930 2521 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090935 2521 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090940 2521 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090945 2521 flags.go:64] FLAG: --cgroup-root="" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090950 2521 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090955 2521 flags.go:64] FLAG: --client-ca-file="" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090968 2521 flags.go:64] FLAG: --cloud-provider="external" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090973 2521 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090985 2521 flags.go:64] FLAG: --cluster-domain="" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090990 2521 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.090995 2521 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091000 2521 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091006 2521 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091012 2521 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091019 2521 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091024 2521 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 00:35:16.096899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091029 2521 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091034 2521 flags.go:64] FLAG: --contention-profiling="false" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091039 2521 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091044 2521 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091050 2521 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091054 2521 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091061 2521 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091066 2521 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091070 2521 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091075 2521 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091081 2521 flags.go:64] FLAG: --enable-server="true" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091086 2521 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091096 2521 flags.go:64] FLAG: --event-burst="100" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091101 2521 flags.go:64] FLAG: --event-qps="50" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091106 2521 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091111 2521 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091115 2521 flags.go:64] FLAG: --eviction-hard="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091121 2521 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091126 2521 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091131 2521 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091136 2521 flags.go:64] FLAG: --eviction-soft="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091141 2521 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091146 2521 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091159 2521 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091164 2521 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 00:35:16.097507 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091168 2521 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091173 2521 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091178 2521 flags.go:64] FLAG: --feature-gates="" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091184 2521 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091190 2521 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091197 2521 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091202 2521 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091206 2521 flags.go:64] FLAG: --healthz-port="10248" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091211 2521 flags.go:64] FLAG: --help="false" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091216 2521 flags.go:64] FLAG: --hostname-override="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091221 2521 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091225 2521 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091231 2521 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091236 2521 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091242 2521 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091246 2521 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091251 2521 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091257 2521 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091262 2521 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091267 2521 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091272 2521 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091277 2521 flags.go:64] FLAG: --kube-reserved="" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091282 2521 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091287 2521 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 00:35:16.098138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091292 2521 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091297 2521 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091301 2521 flags.go:64] FLAG: --lock-file="" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091306 2521 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091310 2521 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091315 2521 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091323 2521 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091339 2521 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091344 2521 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091350 2521 flags.go:64] FLAG: --logging-format="text" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091354 2521 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091360 2521 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091364 2521 flags.go:64] FLAG: --manifest-url="" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091369 2521 flags.go:64] FLAG: --manifest-url-header="" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091377 2521 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091382 2521 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091395 2521 flags.go:64] FLAG: --max-pods="110" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091400 2521 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091404 2521 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091409 2521 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091413 2521 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091418 2521 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091422 2521 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091427 2521 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091456 2521 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 00:35:16.098847 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091463 2521 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091468 2521 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091473 2521 flags.go:64] FLAG: --pod-cidr="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091478 2521 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091486 2521 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091490 2521 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091495 2521 flags.go:64] FLAG: --pods-per-core="0" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091500 2521 flags.go:64] FLAG: --port="10250" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091505 2521 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091509 2521 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e10b0dc5007ae118" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091515 2521 flags.go:64] FLAG: --qos-reserved="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091520 2521 flags.go:64] FLAG: --read-only-port="10255" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091525 2521 flags.go:64] FLAG: --register-node="true" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091529 2521 flags.go:64] FLAG: --register-with-taints="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091535 2521 flags.go:64] FLAG: --registry-burst="10" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091548 2521 flags.go:64] FLAG: --registry-qps="5" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091554 2521 flags.go:64] FLAG: --reserved-cpus="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091558 2521 flags.go:64] FLAG: --reserved-memory="" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091564 2521 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091569 2521 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091574 2521 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091578 2521 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091583 2521 flags.go:64] FLAG: --runonce="false" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091588 2521 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091594 2521 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 00:35:16.099604 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091598 2521 flags.go:64] FLAG: --seccomp-default="false" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091603 2521 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091608 2521 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091613 2521 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091618 2521 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091623 2521 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091627 2521 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091634 2521 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091639 2521 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091644 2521 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091649 2521 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091654 2521 flags.go:64] FLAG: --system-cgroups="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091658 2521 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091667 2521 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091671 2521 flags.go:64] FLAG: --tls-cert-file="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091676 2521 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091687 2521 flags.go:64] FLAG: --tls-min-version="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091692 2521 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091697 2521 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091702 2521 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091707 2521 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091711 2521 flags.go:64] FLAG: --v="2" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091717 2521 flags.go:64] FLAG: --version="false" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091732 2521 flags.go:64] FLAG: --vmodule="" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091739 2521 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 00:35:16.100237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.091744 2521 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091965 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091971 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091979 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091985 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091990 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.091995 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092000 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092004 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092009 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092014 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092020 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092024 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092029 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092035 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092040 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092044 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092049 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092053 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.100916 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092058 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092062 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092066 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092072 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092078 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092083 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092087 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092092 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092097 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092101 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092106 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092110 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092122 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092127 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092131 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092136 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092140 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092145 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092149 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.101376 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092153 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092157 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092161 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092166 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092170 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092174 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092178 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092182 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092188 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092192 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092196 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092201 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092205 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092209 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092213 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092217 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092221 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092225 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092231 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092235 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.101903 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092239 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092243 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092247 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092252 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092256 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092260 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092272 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092277 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092282 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092286 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092290 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092294 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092298 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092303 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092307 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092311 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092316 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092320 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092324 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092328 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.102404 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092333 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092338 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092342 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092346 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092350 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092354 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092359 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092363 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092367 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092371 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092377 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092382 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092386 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092391 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092397 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092403 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092408 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092412 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092416 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.102930 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092428 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092449 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.092454 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.093337 2521 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101077 2521 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101096 2521 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101114 2521 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101121 2521 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101178 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101183 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101186 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101189 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101193 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101196 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101199 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.103401 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101202 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101204 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101207 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101210 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101212 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101215 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101218 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101220 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101224 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101228 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101231 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101234 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101237 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101240 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101243 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101245 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101248 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101251 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101253 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101256 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.103811 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101258 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101261 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101265 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101268 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101270 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101273 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101276 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101278 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101281 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101284 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101286 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101289 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101291 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101293 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101296 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101299 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101301 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101304 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101306 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.104313 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101309 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101311 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101314 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101316 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101320 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101324 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101327 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101330 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101333 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101337 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101340 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101342 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101345 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101347 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101350 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101354 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101357 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101360 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.104954 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101363 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101365 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101368 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101370 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101373 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101375 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101378 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101380 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101383 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101386 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101390 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101392 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101395 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101397 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101400 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101402 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101405 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101407 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101410 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101412 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.105407 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101415 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101418 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101421 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101423 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101426 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101429 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101431 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101447 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101449 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101452 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101456 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101462 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101465 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101467 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101470 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.105909 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101475 2521 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101584 2521 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101588 2521 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101591 2521 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101594 2521 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101597 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101600 2521 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101603 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101605 2521 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101608 2521 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101610 2521 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101613 2521 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101615 2521 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101618 2521 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101621 2521 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101623 2521 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101626 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101629 2521 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101631 2521 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101634 2521 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:16.106291 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101636 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101639 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101641 2521 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101644 2521 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101647 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101649 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101652 2521 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101654 2521 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101657 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101660 2521 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101663 2521 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101665 2521 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101669 2521 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101673 2521 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101676 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101679 2521 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101682 2521 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101684 2521 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101687 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101690 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:16.106828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101693 2521 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101696 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101698 2521 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101701 2521 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101703 2521 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101706 2521 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101708 2521 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101711 2521 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101714 2521 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101717 2521 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101719 2521 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101722 2521 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101724 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101728 2521 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101732 2521 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101734 2521 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101737 2521 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101740 2521 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101742 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:16.107327 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101745 2521 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101747 2521 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101750 2521 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101753 2521 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101755 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101758 2521 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101760 2521 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101763 2521 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101765 2521 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101768 2521 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101770 2521 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101772 2521 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101775 2521 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101777 2521 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101780 2521 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101783 2521 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101785 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101787 2521 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101790 2521 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101793 2521 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:16.107828 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101795 2521 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101798 2521 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101801 2521 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101804 2521 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101806 2521 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101809 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101812 2521 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101814 2521 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101817 2521 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101819 2521 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101822 2521 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101826 2521 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101829 2521 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101831 2521 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101834 2521 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101837 2521 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101841 2521 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101843 2521 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101846 2521 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101849 2521 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:16.108317 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:16.101852 2521 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101857 2521 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.101978 2521 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.104406 2521 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.106063 2521 server.go:1019] "Starting client certificate rotation" Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.106171 2521 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:16.108840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.106232 2521 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:16.109011 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.108997 2521 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:16.115725 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.115690 2521 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:16.128930 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.128905 2521 log.go:25] "Validated CRI v1 runtime API" Jun 10 00:35:16.132910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.132892 2521 log.go:25] "Validated CRI v1 image API" Jun 10 00:35:16.133803 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.133783 2521 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 00:35:16.136245 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.136228 2521 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:16.137258 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.137235 2521 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8a610ff9-fc57-4c96-ac56-045e14f5b4d8:/dev/nvme0n1p4 fe30e528-bcd2-4b99-be6f-41abcf99078f:/dev/nvme0n1p3] Jun 10 00:35:16.137341 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.137256 2521 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 00:35:16.142554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.142421 2521 manager.go:216] Machine: {Timestamp:2026-06-10 00:35:16.141886136 +0000 UTC m=+0.387345207 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086286 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dfdeded97bd917f7d601daa7a6656 SystemUUID:ec2dfded-ed97-bd91-7f7d-601daa7a6656 BootID:d8b659fe-10fb-44b6-aeb4-21d6415c5fc1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:ef:92:f6:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:ef:92:f6:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:d5:f2:b8:bb:24 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 00:35:16.142554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.142548 2521 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 00:35:16.142681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.142636 2521 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 00:35:16.143967 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.143940 2521 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 00:35:16.144124 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.143972 2521 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 00:35:16.144804 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.144792 2521 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 00:35:16.144840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.144805 2521 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 00:35:16.144840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.144813 2521 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:16.144840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.144825 2521 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:16.146192 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.146181 2521 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 00:35:16.150669 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150651 2521 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:16.150812 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150801 2521 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 00:35:16.150856 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150835 2521 kubelet.go:486] "Attempting to sync node with API server" Jun 10 00:35:16.150856 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150852 2521 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 00:35:16.150910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150867 2521 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 00:35:16.150910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150879 2521 kubelet.go:398] "Adding apiserver pod source" Jun 10 00:35:16.150910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.150888 2521 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 00:35:16.151311 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.151299 2521 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:16.151731 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.151319 2521 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:16.154012 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.153983 2521 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 00:35:16.155838 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.155817 2521 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 00:35:16.155896 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.155853 2521 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 00:35:16.157369 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157356 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157373 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157379 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157384 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157393 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157398 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157406 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157412 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157419 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 00:35:16.157421 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157424 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 00:35:16.157759 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157448 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 00:35:16.157759 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157455 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 00:35:16.157759 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.157713 2521 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfpvs" Jun 10 00:35:16.158281 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.158269 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 00:35:16.158333 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.158282 2521 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 00:35:16.158501 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.158481 2521 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 00:35:16.158582 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.158543 2521 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 00:35:16.162250 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.162208 2521 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 00:35:16.162329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.162254 2521 server.go:1268] "Started kubelet" Jun 10 00:35:16.162329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.162270 2521 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 00:35:16.162467 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.162354 2521 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 00:35:16.162572 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.162542 2521 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 00:35:16.163418 ip-10-0-140-158 systemd[1]: Started Kubernetes Kubelet. Jun 10 00:35:16.164563 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.164544 2521 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 00:35:16.167895 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.167872 2521 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfpvs" Jun 10 00:35:16.168268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.168254 2521 server.go:310] "Adding debug handlers to kubelet server" Jun 10 00:35:16.170945 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.170927 2521 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 00:35:16.171789 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.170692 2521 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-158.ec2.internal.18b791197471bd29 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-158.ec2.internal,UID:ip-10-0-140-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-158.ec2.internal,},FirstTimestamp:2026-06-10 00:35:16.162141481 +0000 UTC m=+0.407600551,LastTimestamp:2026-06-10 00:35:16.162141481 +0000 UTC m=+0.407600551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-158.ec2.internal,}" Jun 10 00:35:16.174861 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.174844 2521 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 00:35:16.174861 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.174851 2521 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:16.174978 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.174917 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.176819 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.176795 2521 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 00:35:16.176819 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.176816 2521 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 00:35:16.176955 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.176825 2521 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 00:35:16.177190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177171 2521 reconstruct.go:97] "Volume reconstruction finished" Jun 10 00:35:16.177190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177188 2521 reconciler.go:29] "Reconciler: start to sync state" Jun 10 00:35:16.177632 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177615 2521 factory.go:153] Registering CRI-O factory Jun 10 00:35:16.177695 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177651 2521 factory.go:223] Registration of the crio container factory successfully Jun 10 00:35:16.177695 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177693 2521 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 00:35:16.177752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177700 2521 factory.go:55] Registering systemd factory Jun 10 00:35:16.177752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177706 2521 factory.go:223] Registration of the systemd container factory successfully Jun 10 00:35:16.177752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177727 2521 factory.go:103] Registering Raw factory Jun 10 00:35:16.177752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.177739 2521 manager.go:1196] Started watching for new ooms in manager Jun 10 00:35:16.178869 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.178790 2521 manager.go:349] Starting recovery of all containers Jun 10 00:35:16.183232 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.183208 2521 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:16.185579 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.185553 2521 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-158.ec2.internal\" not found" node="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.190665 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.190647 2521 manager.go:354] Recovery completed Jun 10 00:35:16.195728 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.195706 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.199782 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.199758 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.199872 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.199796 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.199872 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.199808 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.200391 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.200376 2521 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 00:35:16.200391 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.200390 2521 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 00:35:16.200487 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.200409 2521 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:16.200487 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.200449 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.202656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202641 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.202713 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202666 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.202713 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202676 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.202859 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202847 2521 policy_none.go:49] "None policy: Start" Jun 10 00:35:16.202901 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202866 2521 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 00:35:16.202901 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.202879 2521 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 00:35:16.204742 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.204729 2521 policy_none.go:47] "Start" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237022 2521 manager.go:337] "Starting Device Plugin manager" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.237055 2521 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237065 2521 server.go:87] "Starting device plugin registration server" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237318 2521 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237328 2521 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237485 2521 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237567 2521 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.237576 2521 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.238304 2521 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.238356 2521 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.242202 2521 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.243393 2521 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.243452 2521 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.243482 2521 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.243523 2521 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 00:35:16.253076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.245336 2521 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:16.338027 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.337939 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.338939 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.338917 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.339063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.338947 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.339063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.338959 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.339063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.338983 2521 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.343904 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.343878 2521 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal"] Jun 10 00:35:16.344008 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.343943 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.344795 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.344779 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.344864 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.344810 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.344864 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.344820 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.346598 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.346583 2521 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.346661 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.346604 2521 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-158.ec2.internal\": node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.347122 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347109 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.347270 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347255 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.347317 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347303 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.347895 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347877 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.348002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347881 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.348002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347906 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.348002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347924 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.348002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347925 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.348002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.347945 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.350121 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.350103 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.350222 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.350135 2521 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:16.350908 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.350888 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:16.350993 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.350923 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:16.350993 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.350939 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:16.359998 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.359982 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.376353 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.376331 2521 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-158.ec2.internal\" not found" node="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.378339 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.378320 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22450486f5446dc8ab729a99a08f76a6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"22450486f5446dc8ab729a99a08f76a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.378402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.378357 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.378402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.378396 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.381016 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.381000 2521 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-158.ec2.internal\" not found" node="ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.460398 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.460372 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.479519 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479495 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.479610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479527 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.479610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479545 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22450486f5446dc8ab729a99a08f76a6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"22450486f5446dc8ab729a99a08f76a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.479610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479590 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.479739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479598 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91830c91fd823906bf3de8bdcd3dd0c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"91830c91fd823906bf3de8bdcd3dd0c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.479739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.479677 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22450486f5446dc8ab729a99a08f76a6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"22450486f5446dc8ab729a99a08f76a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.560821 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.560768 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.661613 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.661562 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.682111 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.682089 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.687673 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:16.687656 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:16.762425 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.762383 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.863054 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.863019 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:16.963621 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:16.963553 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:17.064210 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:17.064180 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:17.104727 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.104702 2521 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 00:35:17.105267 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.104863 2521 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:17.105267 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.104901 2521 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:17.164930 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:17.164890 2521 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Jun 10 00:35:17.175568 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.175517 2521 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:30:16 +0000 UTC" deadline="2027-12-04 00:31:57.384627831 +0000 UTC" Jun 10 00:35:17.175568 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.175566 2521 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13007h56m40.209067629s" Jun 10 00:35:17.235400 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.235372 2521 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:17.238800 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:17.238738 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22450486f5446dc8ab729a99a08f76a6.slice/crio-736736e85eca16ffdc1103922c43056b35407cb69d9bd96ae7a6af1e4311992c WatchSource:0}: Error finding container 736736e85eca16ffdc1103922c43056b35407cb69d9bd96ae7a6af1e4311992c: Status 404 returned error can't find the container with id 736736e85eca16ffdc1103922c43056b35407cb69d9bd96ae7a6af1e4311992c Jun 10 00:35:17.239266 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:17.239244 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91830c91fd823906bf3de8bdcd3dd0c6.slice/crio-6696d4e04b6abc96a250e7107677040b1026acddd38898b466442366148172ef WatchSource:0}: Error finding container 6696d4e04b6abc96a250e7107677040b1026acddd38898b466442366148172ef: Status 404 returned error can't find the container with id 6696d4e04b6abc96a250e7107677040b1026acddd38898b466442366148172ef Jun 10 00:35:17.244397 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.244381 2521 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:35:17.246108 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.246071 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" event={"ID":"22450486f5446dc8ab729a99a08f76a6","Type":"ContainerStarted","Data":"736736e85eca16ffdc1103922c43056b35407cb69d9bd96ae7a6af1e4311992c"} Jun 10 00:35:17.247176 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.247159 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"91830c91fd823906bf3de8bdcd3dd0c6","Type":"ContainerStarted","Data":"6696d4e04b6abc96a250e7107677040b1026acddd38898b466442366148172ef"} Jun 10 00:35:17.275307 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.275279 2521 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Jun 10 00:35:17.286710 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.286684 2521 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:17.288856 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.288842 2521 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Jun 10 00:35:17.298094 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.298079 2521 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:17.714909 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:17.714816 2521 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:18.152619 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.152532 2521 apiserver.go:52] "Watching apiserver" Jun 10 00:35:18.163019 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.162982 2521 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 00:35:18.163424 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.163399 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-znzd6","kube-system/global-pull-secret-syncer-np6lm","kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84","openshift-image-registry/node-ca-n9zpt","openshift-multus/multus-additional-cni-plugins-vrkkw","openshift-multus/network-metrics-daemon-xbhcm","openshift-network-diagnostics/network-check-target-vqsp9","kube-system/konnectivity-agent-6pcw4","openshift-cluster-node-tuning-operator/tuned-p86jm","openshift-dns/node-resolver-ck45j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal","openshift-multus/multus-5dt5z","openshift-network-operator/iptables-alerter-z6wn2"] Jun 10 00:35:18.166041 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.166015 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.166188 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.166122 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:18.168203 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.168180 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.170211 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.170189 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.171066 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.171042 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 00:35:18.171171 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.171125 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z7khh\"" Jun 10 00:35:18.171237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.171166 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.171237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.171188 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 00:35:18.171237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.171217 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.172538 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.172508 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.172792 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.172774 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.172934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.172916 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b64m5\"" Jun 10 00:35:18.173027 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.173001 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 00:35:18.173076 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.173034 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.174695 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.174676 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.175111 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.175090 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 00:35:18.175308 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.175287 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.175308 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.175299 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-drtgv\"" Jun 10 00:35:18.175473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.175300 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.175640 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.175625 2521 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:18.177270 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.177250 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.177376 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.177282 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bfh8p\"" Jun 10 00:35:18.177376 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.177289 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.177674 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.177629 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 00:35:18.177814 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.177795 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.179912 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.179892 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.180359 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.180304 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 00:35:18.180487 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.180470 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cgwlj\"" Jun 10 00:35:18.180569 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.180524 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 00:35:18.182410 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.182394 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.182586 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.182568 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 00:35:18.182832 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.182811 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 00:35:18.183111 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.183091 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4wzk\"" Jun 10 00:35:18.185760 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.185061 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.185760 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.185147 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:18.185760 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.185463 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g8468\"" Jun 10 00:35:18.186388 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.186119 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 00:35:18.186388 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.186274 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 00:35:18.186388 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.186289 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 00:35:18.186653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.186554 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.188129 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.188113 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.188402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.188316 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 00:35:18.188716 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.188687 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.190293 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190271 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2lt4\" (UniqueName: \"kubernetes.io/projected/b569054a-1cb2-46cb-bcc6-99f6ff515e79-kube-api-access-s2lt4\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.190377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190304 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.190377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190325 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-netns\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.190377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190347 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-daemon-config\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.190377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190369 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190393 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-socket-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190461 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190495 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-hostroot\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190515 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-multus-certs\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190537 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-registration-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190558 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-device-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190584 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhcm\" (UniqueName: \"kubernetes.io/projected/34daa178-b3d2-4745-8425-605fc964b17b-kube-api-access-nfhcm\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.190617 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190617 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-os-release\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190651 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190676 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25l89\" (UniqueName: \"kubernetes.io/projected/e204723b-797e-42f4-beb4-2dd1f95805c8-kube-api-access-25l89\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190699 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cni-binary-copy\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190716 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-socket-dir-parent\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190734 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bb7938-d192-47db-9cd6-0b4ab3b153af-host-slash\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190763 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b569054a-1cb2-46cb-bcc6-99f6ff515e79-host\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190794 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-cnibin\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190825 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190854 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z76g\" (UniqueName: \"kubernetes.io/projected/18800945-fb59-462f-8b55-11e825d11608-kube-api-access-4z76g\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190870 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-etc-kubernetes\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190890 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8s2\" (UniqueName: \"kubernetes.io/projected/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-kube-api-access-6s8s2\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190925 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-sys-fs\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.191023 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190958 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.190982 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-kubelet\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191111 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gjq6\" (UniqueName: \"kubernetes.io/projected/f0bb7938-d192-47db-9cd6-0b4ab3b153af-kube-api-access-6gjq6\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191149 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b569054a-1cb2-46cb-bcc6-99f6ff515e79-serviceca\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191172 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-bin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191195 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-multus\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191211 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191218 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-system-cni-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191241 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-os-release\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191264 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-k8s-cni-cncf-io\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191286 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-conf-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191306 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191341 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-system-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191389 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cnibin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191418 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bb7938-d192-47db-9cd6-0b4ab3b153af-iptables-alerter-script\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.191636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.191488 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.193740 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.193595 2521 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:18.193740 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.193680 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:18.193957 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.193744 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:18.193957 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.193893 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qmb8\"" Jun 10 00:35:18.194134 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.194119 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.194199 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.194141 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 00:35:18.194351 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.194335 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.194399 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.194378 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 00:35:18.194675 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.194658 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2jz9r\"" Jun 10 00:35:18.201248 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.201231 2521 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:18.212722 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.212697 2521 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mnmk" Jun 10 00:35:18.220746 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.220721 2521 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8mnmk" Jun 10 00:35:18.278503 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.278474 2521 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 00:35:18.292591 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292562 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhcm\" (UniqueName: \"kubernetes.io/projected/34daa178-b3d2-4745-8425-605fc964b17b-kube-api-access-nfhcm\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.292591 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292599 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-var-lib-kubelet\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.292834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292617 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-tuned\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.292834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292637 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-systemd-units\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.292834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292693 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.292834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292784 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-node-log\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.292834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292825 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292851 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-script-lib\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292886 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cni-binary-copy\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292911 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-socket-dir-parent\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292935 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bb7938-d192-47db-9cd6-0b4ab3b153af-host-slash\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292961 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44be8050-f6c2-4a23-8515-1d9d33b45109-konnectivity-ca\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.292985 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-etc-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293009 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b569054a-1cb2-46cb-bcc6-99f6ff515e79-host\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293017 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-socket-dir-parent\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293034 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-cnibin\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293034 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bb7938-d192-47db-9cd6-0b4ab3b153af-host-slash\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.293077 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293071 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293074 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-cnibin\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293113 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b569054a-1cb2-46cb-bcc6-99f6ff515e79-host\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293156 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-etc-kubernetes\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293183 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8s2\" (UniqueName: \"kubernetes.io/projected/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-kube-api-access-6s8s2\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293223 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-sys-fs\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293221 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-etc-kubernetes\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293248 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-kubelet-config\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293273 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-dbus\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293300 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-kubelet\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293327 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gjq6\" (UniqueName: \"kubernetes.io/projected/f0bb7938-d192-47db-9cd6-0b4ab3b153af-kube-api-access-6gjq6\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293353 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-kubelet\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293378 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293402 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-systemd\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293424 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-run\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293464 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-host\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293526 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldd9b\" (UniqueName: \"kubernetes.io/projected/927dbbce-27c3-46ed-9b51-10e7877c7d59-kube-api-access-ldd9b\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.293599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293553 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-config\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293571 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cni-binary-copy\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293654 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-conf\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293684 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-env-overrides\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293712 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-multus\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293753 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-multus\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293757 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-os-release\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293789 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-k8s-cni-cncf-io\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293836 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-conf-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293855 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-os-release\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293862 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovn-node-metrics-cert\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293886 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftlv\" (UniqueName: \"kubernetes.io/projected/cf9348a1-5c89-430a-9ab5-f601ffa78bda-kube-api-access-wftlv\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293903 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-k8s-cni-cncf-io\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293922 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039c063d-1d7c-467b-8ef5-9e468078a18c-hosts-file\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293927 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293914 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-sys-fs\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.293974 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br4rd\" (UniqueName: \"kubernetes.io/projected/039c063d-1d7c-467b-8ef5-9e468078a18c-kube-api-access-br4rd\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.294358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294022 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294053 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-system-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294120 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-system-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.294182 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294196 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cnibin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294221 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bb7938-d192-47db-9cd6-0b4ab3b153af-iptables-alerter-script\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294272 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294153 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-conf-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294276 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-cnibin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.294337 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.794275584 +0000 UTC m=+3.039734654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294386 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294386 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-sys\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294430 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2lt4\" (UniqueName: \"kubernetes.io/projected/b569054a-1cb2-46cb-bcc6-99f6ff515e79-kube-api-access-s2lt4\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294887 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-netns\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.294969 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-device-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295007 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysconfig\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295011 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-netns\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295078 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-device-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295117 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-netns\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295154 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-var-lib-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295185 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-log-socket\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295226 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295269 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-hostroot\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295295 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-multus-certs\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295326 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-registration-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295363 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-os-release\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295348 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-hostroot\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295395 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295424 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-run-multus-certs\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295448 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-registration-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295541 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-os-release\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295580 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295704 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25l89\" (UniqueName: \"kubernetes.io/projected/e204723b-797e-42f4-beb4-2dd1f95805c8-kube-api-access-25l89\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295753 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-modprobe-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.295898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295726 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bb7938-d192-47db-9cd6-0b4ab3b153af-iptables-alerter-script\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295796 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-kubernetes\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295830 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44be8050-f6c2-4a23-8515-1d9d33b45109-agent-certs\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295862 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-ovn\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295902 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z76g\" (UniqueName: \"kubernetes.io/projected/18800945-fb59-462f-8b55-11e825d11608-kube-api-access-4z76g\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295936 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-cni-binary-copy\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.295999 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296159 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-lib-modules\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296231 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-tmp\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296346 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296380 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b569054a-1cb2-46cb-bcc6-99f6ff515e79-serviceca\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.296638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296531 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296717 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-bin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296790 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-system-cni-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296823 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296830 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b569054a-1cb2-46cb-bcc6-99f6ff515e79-serviceca\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296861 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-bin\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296880 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18800945-fb59-462f-8b55-11e825d11608-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296934 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-netd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296966 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039c063d-1d7c-467b-8ef5-9e468078a18c-tmp-dir\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296975 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18800945-fb59-462f-8b55-11e825d11608-system-cni-dir\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.296993 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-systemd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297035 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-host-var-lib-cni-bin\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297102 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.297164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297136 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-daemon-config\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297211 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-cni-dir\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297253 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297309 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-socket-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297390 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297573 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34daa178-b3d2-4745-8425-605fc964b17b-socket-dir\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297614 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-kubelet\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.297780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297677 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-slash\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.298085 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.297805 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-multus-daemon-config\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.300153 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.300131 2521 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 00:35:18.304115 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.304089 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhcm\" (UniqueName: \"kubernetes.io/projected/34daa178-b3d2-4745-8425-605fc964b17b-kube-api-access-nfhcm\") pod \"aws-ebs-csi-driver-node-5fz84\" (UID: \"34daa178-b3d2-4745-8425-605fc964b17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.304237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.304121 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gjq6\" (UniqueName: \"kubernetes.io/projected/f0bb7938-d192-47db-9cd6-0b4ab3b153af-kube-api-access-6gjq6\") pod \"iptables-alerter-z6wn2\" (UID: \"f0bb7938-d192-47db-9cd6-0b4ab3b153af\") " pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.304237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.304147 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2lt4\" (UniqueName: \"kubernetes.io/projected/b569054a-1cb2-46cb-bcc6-99f6ff515e79-kube-api-access-s2lt4\") pod \"node-ca-n9zpt\" (UID: \"b569054a-1cb2-46cb-bcc6-99f6ff515e79\") " pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.304362 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.304318 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z76g\" (UniqueName: \"kubernetes.io/projected/18800945-fb59-462f-8b55-11e825d11608-kube-api-access-4z76g\") pod \"multus-additional-cni-plugins-vrkkw\" (UID: \"18800945-fb59-462f-8b55-11e825d11608\") " pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.304493 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.304460 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8s2\" (UniqueName: \"kubernetes.io/projected/de1d8fed-c6e7-46bf-aa8b-3e60efc492d8-kube-api-access-6s8s2\") pod \"multus-5dt5z\" (UID: \"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8\") " pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.305662 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.305644 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25l89\" (UniqueName: \"kubernetes.io/projected/e204723b-797e-42f4-beb4-2dd1f95805c8-kube-api-access-25l89\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.398163 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398128 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-kubelet\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398163 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398166 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-slash\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398185 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-var-lib-kubelet\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398205 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-tuned\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398227 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-systemd-units\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398261 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-slash\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398282 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-systemd-units\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398271 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-kubelet\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398294 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398325 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-node-log\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398351 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398378 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-script-lib\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398371 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-var-lib-kubelet\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398404 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-node-log\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.398407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398414 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44be8050-f6c2-4a23-8515-1d9d33b45109-konnectivity-ca\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398325 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398480 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398467 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-etc-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398528 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-kubelet-config\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398553 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-dbus\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398594 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398619 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-systemd\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398646 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-run\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398666 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-host\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398705 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldd9b\" (UniqueName: \"kubernetes.io/projected/927dbbce-27c3-46ed-9b51-10e7877c7d59-kube-api-access-ldd9b\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398729 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-config\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398750 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-conf\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398772 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-env-overrides\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398801 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovn-node-metrics-cert\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398827 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftlv\" (UniqueName: \"kubernetes.io/projected/cf9348a1-5c89-430a-9ab5-f601ffa78bda-kube-api-access-wftlv\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398849 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039c063d-1d7c-467b-8ef5-9e468078a18c-hosts-file\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.399053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398873 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br4rd\" (UniqueName: \"kubernetes.io/projected/039c063d-1d7c-467b-8ef5-9e468078a18c-kube-api-access-br4rd\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398914 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44be8050-f6c2-4a23-8515-1d9d33b45109-konnectivity-ca\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398919 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-sys\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398963 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysconfig\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398968 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-sys\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.398989 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-netns\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399012 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-script-lib\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399019 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-etc-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399044 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysconfig\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399101 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-systemd\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399104 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-host\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399168 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-run\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399286 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-kubelet-config\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399288 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-dbus\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399316 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-netns\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.399367 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399383 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-env-overrides\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399449 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-var-lib-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.399879 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399457 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-conf\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399482 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-log-socket\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399517 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-var-lib-openvswitch\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399524 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-modprobe-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399563 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-log-socket\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.399589 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.899567655 +0000 UTC m=+3.145026726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399591 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/039c063d-1d7c-467b-8ef5-9e468078a18c-hosts-file\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399613 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-kubernetes\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399629 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-modprobe-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399659 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44be8050-f6c2-4a23-8515-1d9d33b45109-agent-certs\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399672 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovnkube-config\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399685 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-ovn\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399712 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-kubernetes\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399718 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-lib-modules\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399741 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-tmp\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399768 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-ovn\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399848 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.400707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399875 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399885 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-lib-modules\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399900 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399909 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-run-ovn-kubernetes\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399944 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-bin\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399970 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-netd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.399993 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039c063d-1d7c-467b-8ef5-9e468078a18c-tmp-dir\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400028 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-systemd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400029 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-sysctl-d\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400111 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-bin\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400187 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-run-systemd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400237 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf9348a1-5c89-430a-9ab5-f601ffa78bda-host-cni-netd\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.400372 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/039c063d-1d7c-467b-8ef5-9e468078a18c-tmp-dir\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.401348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.401021 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-etc-tuned\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.401990 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.401944 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf9348a1-5c89-430a-9ab5-f601ffa78bda-ovn-node-metrics-cert\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.402281 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.402259 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927dbbce-27c3-46ed-9b51-10e7877c7d59-tmp\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.402552 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.402531 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44be8050-f6c2-4a23-8515-1d9d33b45109-agent-certs\") pod \"konnectivity-agent-6pcw4\" (UID: \"44be8050-f6c2-4a23-8515-1d9d33b45109\") " pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.406544 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.406490 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:18.406544 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.406515 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:18.406544 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.406529 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:18.406747 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.406587 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.906569327 +0000 UTC m=+3.152028399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:18.408170 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.408145 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br4rd\" (UniqueName: \"kubernetes.io/projected/039c063d-1d7c-467b-8ef5-9e468078a18c-kube-api-access-br4rd\") pod \"node-resolver-ck45j\" (UID: \"039c063d-1d7c-467b-8ef5-9e468078a18c\") " pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.408587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.408563 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftlv\" (UniqueName: \"kubernetes.io/projected/cf9348a1-5c89-430a-9ab5-f601ffa78bda-kube-api-access-wftlv\") pod \"ovnkube-node-znzd6\" (UID: \"cf9348a1-5c89-430a-9ab5-f601ffa78bda\") " pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.408744 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.408726 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldd9b\" (UniqueName: \"kubernetes.io/projected/927dbbce-27c3-46ed-9b51-10e7877c7d59-kube-api-access-ldd9b\") pod \"tuned-p86jm\" (UID: \"927dbbce-27c3-46ed-9b51-10e7877c7d59\") " pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.479756 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.479714 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dt5z" Jun 10 00:35:18.489142 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.489119 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6wn2" Jun 10 00:35:18.499826 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.499791 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" Jun 10 00:35:18.502321 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.502302 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9zpt" Jun 10 00:35:18.510013 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.509994 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" Jun 10 00:35:18.516605 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.516583 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:18.523287 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.523266 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:18.530141 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.530120 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p86jm" Jun 10 00:35:18.535786 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.535763 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ck45j" Jun 10 00:35:18.694491 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.694380 2521 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:18.803514 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.803480 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:18.803678 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.803625 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.803722 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.803684 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:19.803668625 +0000 UTC m=+4.049127686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.904572 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:18.904530 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:18.904754 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.904696 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:18.904815 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:18.904771 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:19.904751631 +0000 UTC m=+4.150210688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:19.005361 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.005251 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:19.005532 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.005453 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:19.005532 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.005489 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:19.005532 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.005501 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:19.005667 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.005559 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:20.005544714 +0000 UTC m=+4.251003771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:19.068989 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.068956 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb569054a_1cb2_46cb_bcc6_99f6ff515e79.slice/crio-bd091e6049904c5462266db620775d3d66afcbe8c8d92714159f872a82876e78 WatchSource:0}: Error finding container bd091e6049904c5462266db620775d3d66afcbe8c8d92714159f872a82876e78: Status 404 returned error can't find the container with id bd091e6049904c5462266db620775d3d66afcbe8c8d92714159f872a82876e78 Jun 10 00:35:19.070485 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.070460 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9348a1_5c89_430a_9ab5_f601ffa78bda.slice/crio-aa19fb950b3614b079d43505e9abf8936d6bea8cec841e311e8ca62168c9ca3d WatchSource:0}: Error finding container aa19fb950b3614b079d43505e9abf8936d6bea8cec841e311e8ca62168c9ca3d: Status 404 returned error can't find the container with id aa19fb950b3614b079d43505e9abf8936d6bea8cec841e311e8ca62168c9ca3d Jun 10 00:35:19.072097 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.072069 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44be8050_f6c2_4a23_8515_1d9d33b45109.slice/crio-0a766ae1c9e29f5f28d4911accbc50831e16cb7ab7e020a594084e72bff5a81c WatchSource:0}: Error finding container 0a766ae1c9e29f5f28d4911accbc50831e16cb7ab7e020a594084e72bff5a81c: Status 404 returned error can't find the container with id 0a766ae1c9e29f5f28d4911accbc50831e16cb7ab7e020a594084e72bff5a81c Jun 10 00:35:19.077036 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.077016 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c063d_1d7c_467b_8ef5_9e468078a18c.slice/crio-7fae413d1324192f0ecc5cf52baa9699b6dc4a4cd58a4d6ecf7da5ad4ab8330d WatchSource:0}: Error finding container 7fae413d1324192f0ecc5cf52baa9699b6dc4a4cd58a4d6ecf7da5ad4ab8330d: Status 404 returned error can't find the container with id 7fae413d1324192f0ecc5cf52baa9699b6dc4a4cd58a4d6ecf7da5ad4ab8330d Jun 10 00:35:19.099421 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.099390 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1d8fed_c6e7_46bf_aa8b_3e60efc492d8.slice/crio-3380a899d264fe1a5411678c8b145f125e9792d03edc2c296170e86b8bc4727d WatchSource:0}: Error finding container 3380a899d264fe1a5411678c8b145f125e9792d03edc2c296170e86b8bc4727d: Status 404 returned error can't find the container with id 3380a899d264fe1a5411678c8b145f125e9792d03edc2c296170e86b8bc4727d Jun 10 00:35:19.101731 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.101702 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bb7938_d192_47db_9cd6_0b4ab3b153af.slice/crio-1e2e8ef847e1cefe48b16bdf09da10c6751fbdae89107b88c04d4de0c3dce533 WatchSource:0}: Error finding container 1e2e8ef847e1cefe48b16bdf09da10c6751fbdae89107b88c04d4de0c3dce533: Status 404 returned error can't find the container with id 1e2e8ef847e1cefe48b16bdf09da10c6751fbdae89107b88c04d4de0c3dce533 Jun 10 00:35:19.103510 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.103485 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927dbbce_27c3_46ed_9b51_10e7877c7d59.slice/crio-b20fe5ba30ba3da790146ed1bc3e742df60cc66809d49a6dc867360a093cd947 WatchSource:0}: Error finding container b20fe5ba30ba3da790146ed1bc3e742df60cc66809d49a6dc867360a093cd947: Status 404 returned error can't find the container with id b20fe5ba30ba3da790146ed1bc3e742df60cc66809d49a6dc867360a093cd947 Jun 10 00:35:19.105804 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.105775 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34daa178_b3d2_4745_8425_605fc964b17b.slice/crio-4968ae9afe15dcec79a49534245c76c5baafe0bd154fa91e713573395f07d11b WatchSource:0}: Error finding container 4968ae9afe15dcec79a49534245c76c5baafe0bd154fa91e713573395f07d11b: Status 404 returned error can't find the container with id 4968ae9afe15dcec79a49534245c76c5baafe0bd154fa91e713573395f07d11b Jun 10 00:35:19.106968 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:19.106857 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18800945_fb59_462f_8b55_11e825d11608.slice/crio-c2985a19d8ac6befd184d960cba6bb39b32e16c057863bac32a82ff6f0d45108 WatchSource:0}: Error finding container c2985a19d8ac6befd184d960cba6bb39b32e16c057863bac32a82ff6f0d45108: Status 404 returned error can't find the container with id c2985a19d8ac6befd184d960cba6bb39b32e16c057863bac32a82ff6f0d45108 Jun 10 00:35:19.224157 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.224081 2521 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:18 +0000 UTC" deadline="2027-12-30 15:51:23.803732151 +0000 UTC" Jun 10 00:35:19.224157 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.224151 2521 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13647h16m4.579583758s" Jun 10 00:35:19.251223 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.251179 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerStarted","Data":"c2985a19d8ac6befd184d960cba6bb39b32e16c057863bac32a82ff6f0d45108"} Jun 10 00:35:19.252353 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.252329 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" event={"ID":"34daa178-b3d2-4745-8425-605fc964b17b","Type":"ContainerStarted","Data":"4968ae9afe15dcec79a49534245c76c5baafe0bd154fa91e713573395f07d11b"} Jun 10 00:35:19.253508 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.253464 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dt5z" event={"ID":"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8","Type":"ContainerStarted","Data":"3380a899d264fe1a5411678c8b145f125e9792d03edc2c296170e86b8bc4727d"} Jun 10 00:35:19.254630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.254608 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ck45j" event={"ID":"039c063d-1d7c-467b-8ef5-9e468078a18c","Type":"ContainerStarted","Data":"7fae413d1324192f0ecc5cf52baa9699b6dc4a4cd58a4d6ecf7da5ad4ab8330d"} Jun 10 00:35:19.255793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.255652 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"aa19fb950b3614b079d43505e9abf8936d6bea8cec841e311e8ca62168c9ca3d"} Jun 10 00:35:19.258079 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.258048 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9zpt" event={"ID":"b569054a-1cb2-46cb-bcc6-99f6ff515e79","Type":"ContainerStarted","Data":"bd091e6049904c5462266db620775d3d66afcbe8c8d92714159f872a82876e78"} Jun 10 00:35:19.260832 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.260807 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" event={"ID":"22450486f5446dc8ab729a99a08f76a6","Type":"ContainerStarted","Data":"5ff9fdf728d2fd53bb5a39a289011e434516734c0c12c7757cae9a3b38c25d6f"} Jun 10 00:35:19.261951 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.261923 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p86jm" event={"ID":"927dbbce-27c3-46ed-9b51-10e7877c7d59","Type":"ContainerStarted","Data":"b20fe5ba30ba3da790146ed1bc3e742df60cc66809d49a6dc867360a093cd947"} Jun 10 00:35:19.262999 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.262980 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6wn2" event={"ID":"f0bb7938-d192-47db-9cd6-0b4ab3b153af","Type":"ContainerStarted","Data":"1e2e8ef847e1cefe48b16bdf09da10c6751fbdae89107b88c04d4de0c3dce533"} Jun 10 00:35:19.264311 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.264292 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pcw4" event={"ID":"44be8050-f6c2-4a23-8515-1d9d33b45109","Type":"ContainerStarted","Data":"0a766ae1c9e29f5f28d4911accbc50831e16cb7ab7e020a594084e72bff5a81c"} Jun 10 00:35:19.277287 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.277241 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" podStartSLOduration=2.2772288290000002 podStartE2EDuration="2.277228829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:19.276805397 +0000 UTC m=+3.522264478" watchObservedRunningTime="2026-06-10 00:35:19.277228829 +0000 UTC m=+3.522687907" Jun 10 00:35:19.811779 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.811070 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:19.811779 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.811374 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:19.811779 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.811459 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:21.811424599 +0000 UTC m=+6.056883662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:19.912043 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:19.912001 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:19.912284 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.912166 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:19.912284 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:19.912229 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:21.912211191 +0000 UTC m=+6.157670253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:20.012805 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.012767 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:20.013020 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.013002 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:20.013087 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.013031 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:20.013087 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.013045 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:20.013226 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.013103 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:22.013084619 +0000 UTC m=+6.258543681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:20.224677 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.224534 2521 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:18 +0000 UTC" deadline="2027-11-24 02:57:56.284245164 +0000 UTC" Jun 10 00:35:20.224677 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.224574 2521 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12770h22m36.059675716s" Jun 10 00:35:20.244601 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.244559 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:20.244601 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.244588 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:20.244821 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.244608 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:20.244821 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.244692 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:20.244927 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.244839 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:20.244984 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:20.244929 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:20.275505 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.275470 2521 generic.go:356] "Generic (PLEG): container finished" podID="91830c91fd823906bf3de8bdcd3dd0c6" containerID="99982a56fbe348d3179de322d68c2dd08772425cc72c96a9e926d12d0df5d70f" exitCode=0 Jun 10 00:35:20.276396 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:20.276368 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"91830c91fd823906bf3de8bdcd3dd0c6","Type":"ContainerDied","Data":"99982a56fbe348d3179de322d68c2dd08772425cc72c96a9e926d12d0df5d70f"} Jun 10 00:35:21.291957 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:21.291919 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"91830c91fd823906bf3de8bdcd3dd0c6","Type":"ContainerStarted","Data":"360fe1b69e1e332525539287bc1c05eaee3f23b34f87c241669be74491dc9271"} Jun 10 00:35:21.312823 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:21.312755 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" podStartSLOduration=4.3127349200000005 podStartE2EDuration="4.31273492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:21.312601184 +0000 UTC m=+5.558060265" watchObservedRunningTime="2026-06-10 00:35:21.31273492 +0000 UTC m=+5.558193994" Jun 10 00:35:21.830193 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:21.829490 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:21.830193 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:21.829705 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:21.830193 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:21.829772 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:25.829752676 +0000 UTC m=+10.075211756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:21.931278 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:21.930644 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:21.931278 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:21.930833 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:21.931278 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:21.930898 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:25.930879171 +0000 UTC m=+10.176338227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:22.031454 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:22.031404 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:22.031681 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.031653 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:22.031751 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.031693 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:22.031751 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.031707 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:22.031854 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.031769 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:26.031748729 +0000 UTC m=+10.277207801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:22.244040 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.244177 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:22.244214 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.244294 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:22.244362 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:22.244529 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:22.244453 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:24.245152 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:24.244510 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:24.245152 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:24.244650 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:24.245152 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:24.245023 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:24.245152 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:24.245110 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:24.245781 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:24.245265 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:24.245781 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:24.245382 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:25.862202 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:25.862087 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:25.862684 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:25.862238 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:25.862684 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:25.862316 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:33.86229563 +0000 UTC m=+18.107754687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:25.962996 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:25.962959 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:25.963162 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:25.963136 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:25.963233 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:25.963205 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:33.963186553 +0000 UTC m=+18.208645614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:26.064060 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:26.064012 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:26.064244 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.064171 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:26.064244 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.064197 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:26.064244 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.064211 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:26.064426 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.064284 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:34.064264087 +0000 UTC m=+18.309723148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:26.244188 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:26.244103 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:26.245949 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:26.245252 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:26.245949 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.245360 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:26.245949 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:26.245733 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:26.245949 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.245835 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:26.245949 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:26.245916 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:28.243828 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:28.243793 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:28.244269 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:28.243803 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:28.244269 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:28.243942 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:28.244269 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:28.243806 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:28.244269 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:28.244013 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:28.244269 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:28.244085 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:30.244143 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:30.244109 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:30.244599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:30.244160 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:30.244599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:30.244109 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:30.244599 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:30.244254 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:30.244599 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:30.244426 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:30.244599 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:30.244567 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:32.244460 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:32.244413 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:32.245047 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:32.244413 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:32.245047 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:32.244570 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:32.245047 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:32.244424 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:32.245047 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:32.244638 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:32.245047 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:32.244727 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:33.922317 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:33.922282 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:33.922784 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:33.922479 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:33.922784 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:33.922561 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:49.922539111 +0000 UTC m=+34.167998169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:34.023139 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:34.023098 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:34.023302 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.023280 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:34.023370 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.023361 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:50.023337564 +0000 UTC m=+34.268796627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:34.124348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:34.124308 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:34.124568 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.124544 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:34.124643 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.124573 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:34.124643 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.124584 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:34.124643 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.124642 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:50.124624092 +0000 UTC m=+34.370083155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:34.247081 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:34.246994 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:34.247081 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:34.247041 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:34.247081 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:34.247041 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:34.247319 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.247130 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:34.247319 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.247192 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:34.247319 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:34.247285 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:36.245809 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:36.245983 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:36.246464 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:36.246603 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:36.246661 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:36.247813 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:36.246762 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.247095 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.247125 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:38.247432 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.247141 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:38.247522 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:38.247656 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:38.247588 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:38.325878 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.325847 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9zpt" event={"ID":"b569054a-1cb2-46cb-bcc6-99f6ff515e79","Type":"ContainerStarted","Data":"ec759866d6347fe89dc6186d4cb5bf09e32d543304ce9e05646c0b49310ea351"} Jun 10 00:35:38.327349 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.327327 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p86jm" event={"ID":"927dbbce-27c3-46ed-9b51-10e7877c7d59","Type":"ContainerStarted","Data":"d14b9871d947367bad500cd01bbd2db6959ebf0dec652b1aaff372633d7dd9d1"} Jun 10 00:35:38.328723 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.328703 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pcw4" event={"ID":"44be8050-f6c2-4a23-8515-1d9d33b45109","Type":"ContainerStarted","Data":"82398759cefef0485239a0123cd368a314eee1a0152a2ca07e52e3e736be9be0"} Jun 10 00:35:38.330115 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.330096 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="c01593b1689a7c5595976e09299966afecdf915acd8102cb754d5d0b7f5c16b0" exitCode=0 Jun 10 00:35:38.330216 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.330173 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"c01593b1689a7c5595976e09299966afecdf915acd8102cb754d5d0b7f5c16b0"} Jun 10 00:35:38.333429 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.333403 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" event={"ID":"34daa178-b3d2-4745-8425-605fc964b17b","Type":"ContainerStarted","Data":"29c0755f260585218314dd734467235fc46fd6de1f10c350de3285e51a1dbea0"} Jun 10 00:35:38.335453 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.335415 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dt5z" event={"ID":"de1d8fed-c6e7-46bf-aa8b-3e60efc492d8","Type":"ContainerStarted","Data":"94b57ad29b9d1fb99e7969a9e75dfd7e12c160dfbbe99de0b5166ed105bab90b"} Jun 10 00:35:38.336824 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.336805 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ck45j" event={"ID":"039c063d-1d7c-467b-8ef5-9e468078a18c","Type":"ContainerStarted","Data":"feefe61111d4be98327d5da75c972bd3a42def98a0e21ed192856abb0a022154"} Jun 10 00:35:38.339669 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.339652 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:35:38.339960 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.339943 2521 generic.go:356] "Generic (PLEG): container finished" podID="cf9348a1-5c89-430a-9ab5-f601ffa78bda" containerID="18d63d0da03cff17abf41e7afd89fa3cc7445e778288d370c39ad38662f3d74f" exitCode=1 Jun 10 00:35:38.340020 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.339969 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"d1c5f82d496cb3836dd16f21c67dba1f3e242dcbb03b3bfbf9cfc2396f956cf7"} Jun 10 00:35:38.340020 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.340012 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"1002e7d7cab4d9ae4a62e976093d7302f2259f387a0cff2f20f41a81e30af3f9"} Jun 10 00:35:38.340086 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.340040 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"c2b363e6a7065b6623dbc79c7bd6cf3b1f91e700f6ac65fafed8395511ed7c5d"} Jun 10 00:35:38.340086 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.340069 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerDied","Data":"18d63d0da03cff17abf41e7afd89fa3cc7445e778288d370c39ad38662f3d74f"} Jun 10 00:35:38.340142 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.340099 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"60c9f624a6c3b464cc61f3c6e71ca968e4f06d46f92370fde6ea7707c56fd479"} Jun 10 00:35:38.341366 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.341328 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n9zpt" podStartSLOduration=3.70674534 podStartE2EDuration="22.341318077s" totalImagesPullingTime="18.634572737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.340736793 +0000 UTC m=+22.586195872" watchObservedRunningTime="2026-06-10 00:35:38.341318077 +0000 UTC m=+22.586777156" Jun 10 00:35:38.355568 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.355493 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6pcw4" podStartSLOduration=8.293118127 podStartE2EDuration="22.355480082s" totalImagesPullingTime="14.062361955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.354805922 +0000 UTC m=+22.600265002" watchObservedRunningTime="2026-06-10 00:35:38.355480082 +0000 UTC m=+22.600939161" Jun 10 00:35:38.376478 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.376405 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5dt5z" podStartSLOduration=3.671604448 podStartE2EDuration="22.376386438s" totalImagesPullingTime="18.70478199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.375674201 +0000 UTC m=+22.621133280" watchObservedRunningTime="2026-06-10 00:35:38.376386438 +0000 UTC m=+22.621845517" Jun 10 00:35:38.415906 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.415845 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p86jm" podStartSLOduration=3.8144447120000002 podStartE2EDuration="22.415825854s" totalImagesPullingTime="18.601381142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.41522664 +0000 UTC m=+22.660685743" watchObservedRunningTime="2026-06-10 00:35:38.415825854 +0000 UTC m=+22.661284934" Jun 10 00:35:38.431371 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.431318 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ck45j" podStartSLOduration=3.822748377 podStartE2EDuration="22.431302215s" totalImagesPullingTime="18.608553838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.431139756 +0000 UTC m=+22.676598835" watchObservedRunningTime="2026-06-10 00:35:38.431302215 +0000 UTC m=+22.676761294" Jun 10 00:35:38.639231 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.639161 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:38.639681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:38.639662 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:39.344508 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:39.344481 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:35:39.345002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:39.344919 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"163dde98442e770b238c3600a406db8631d4dc1c9d4343a0591af7c22ba99b0a"} Jun 10 00:35:39.348754 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:39.348720 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6wn2" event={"ID":"f0bb7938-d192-47db-9cd6-0b4ab3b153af","Type":"ContainerStarted","Data":"d07b05c12f2720195e27dcfea513da65d08d0d2aeebc65dc89e88966cd29542d"} Jun 10 00:35:39.376276 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:39.376229 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z6wn2" podStartSLOduration=4.77564471 podStartE2EDuration="23.376214568s" totalImagesPullingTime="18.600569858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:39.375842127 +0000 UTC m=+23.621301207" watchObservedRunningTime="2026-06-10 00:35:39.376214568 +0000 UTC m=+23.621673646" Jun 10 00:35:39.557871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:39.557839 2521 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 00:35:40.243826 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.243759 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:40.244011 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.243758 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:40.244011 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:40.243902 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:40.244011 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.243944 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:40.244144 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:40.244046 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:40.244144 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:40.244137 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:40.254178 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.254082 2521 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T00:35:39.557862065Z","UUID":"d85ebcf5-420a-4956-af47-e33bbdf339a9","Handler":null,"Name":"","Endpoint":""} Jun 10 00:35:40.256233 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.256165 2521 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 00:35:40.256233 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.256211 2521 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 00:35:40.352584 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.352554 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" event={"ID":"34daa178-b3d2-4745-8425-605fc964b17b","Type":"ContainerStarted","Data":"07e225c5451a060b9bdc80c94aaa016b985ed3096a31f628bd3a062ba1cb2b9b"} Jun 10 00:35:40.352989 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:40.352715 2521 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 00:35:41.357935 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:41.357761 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:35:41.358453 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:41.358406 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"bcb3cbb12df4ba0ae7bdacd0844837ad6e53ae1e138f5f87f68d58a16b001c6f"} Jun 10 00:35:41.360639 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:41.360614 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" event={"ID":"34daa178-b3d2-4745-8425-605fc964b17b","Type":"ContainerStarted","Data":"2d092998cab75e9ffb4266a3ebac34036275bc6f9b318fc115507efd47611631"} Jun 10 00:35:41.380895 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:41.380849 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fz84" podStartSLOduration=4.496444024 podStartE2EDuration="25.380836614s" totalImagesPullingTime="20.88439259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:41.380699799 +0000 UTC m=+25.626158877" watchObservedRunningTime="2026-06-10 00:35:41.380836614 +0000 UTC m=+25.626295689" Jun 10 00:35:42.244324 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:42.244286 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:42.244556 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:42.244334 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:42.244556 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:42.244422 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:42.244654 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:42.244537 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:42.244654 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:42.244589 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:42.244737 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:42.244708 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:44.244797 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.244611 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:44.245534 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.244653 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:44.245534 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:44.244870 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:44.245534 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.244678 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:44.245534 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:44.244942 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:44.245534 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:44.245043 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:44.370038 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.370006 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="7d48b1dcd7456890aad724a5dcf830917a15eba57f8bf41d764b37a4f3291de4" exitCode=0 Jun 10 00:35:44.370241 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.370095 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"7d48b1dcd7456890aad724a5dcf830917a15eba57f8bf41d764b37a4f3291de4"} Jun 10 00:35:44.373343 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.373324 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:35:44.373729 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.373705 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"fca1cbfc994cd45f1261ac31e706b417f3def36d511fbff3346740df3b9c9ba9"} Jun 10 00:35:44.374003 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.373984 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:44.374101 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.374045 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:44.374150 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.374118 2521 scope.go:117] "RemoveContainer" containerID="18d63d0da03cff17abf41e7afd89fa3cc7445e778288d370c39ad38662f3d74f" Jun 10 00:35:44.389679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:44.389657 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:45.377652 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.377568 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="74d46f63a73370f1b53bd4db3a75c3aee85ed9979d8e68c8b577bb9ebc41ce8a" exitCode=0 Jun 10 00:35:45.378088 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.377662 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"74d46f63a73370f1b53bd4db3a75c3aee85ed9979d8e68c8b577bb9ebc41ce8a"} Jun 10 00:35:45.381719 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.381703 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:35:45.382028 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.382004 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" event={"ID":"cf9348a1-5c89-430a-9ab5-f601ffa78bda","Type":"ContainerStarted","Data":"fac7e1d026664990b8381a72301363d0c46917816a0f57fd1e4fa139721b797b"} Jun 10 00:35:45.382237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.382223 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:45.397197 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.397176 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:35:45.427844 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.427792 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" podStartSLOduration=10.738401241 podStartE2EDuration="29.427777406s" totalImagesPullingTime="18.689376165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:45.427623314 +0000 UTC m=+29.673082394" watchObservedRunningTime="2026-06-10 00:35:45.427777406 +0000 UTC m=+29.673236485" Jun 10 00:35:45.497233 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.497196 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbhcm"] Jun 10 00:35:45.497394 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.497357 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:45.497483 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:45.497463 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:45.500647 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.500615 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqsp9"] Jun 10 00:35:45.500762 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.500744 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:45.500846 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:45.500822 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:45.501351 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.501325 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-np6lm"] Jun 10 00:35:45.501467 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:45.501454 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:45.501570 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:45.501548 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:46.386762 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:46.386530 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="5bc376f00878741c34a81133ad51f9e7b63fec923d1ab8088abaa539b9a605bb" exitCode=0 Jun 10 00:35:46.387199 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:46.386888 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"5bc376f00878741c34a81133ad51f9e7b63fec923d1ab8088abaa539b9a605bb"} Jun 10 00:35:46.784454 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:46.784412 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:46.784685 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:46.784661 2521 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 00:35:46.785101 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:46.785076 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6pcw4" Jun 10 00:35:47.244554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:47.244522 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:47.244798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:47.244648 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:47.244798 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:47.244661 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:47.244798 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:47.244764 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:47.244798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:47.244786 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:47.245019 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:47.244865 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:48.309733 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:48.309646 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:48.446515 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:48.446480 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:49.244475 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.244427 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:49.244475 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.244470 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:49.244696 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.244470 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:49.244696 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.244583 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:35:49.244696 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.244662 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqsp9" podUID="519fbeb8-2649-42c3-b561-c79637c171f6" Jun 10 00:35:49.244858 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.244714 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np6lm" podUID="2b52f7c3-f3e8-4f8e-8e72-652281c1f826" Jun 10 00:35:49.503768 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.503692 2521 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeReady" Jun 10 00:35:49.504291 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.503843 2521 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 00:35:49.598399 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.598361 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:49.601780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.601751 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cv84d"] Jun 10 00:35:49.651924 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.651886 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dkzjd"] Jun 10 00:35:49.652088 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.651897 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.655204 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.655176 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 00:35:49.655326 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.655221 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:35:49.655382 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.655180 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 00:35:49.667555 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.667528 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cv84d"] Jun 10 00:35:49.667681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.667547 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.667681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.667593 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkzjd"] Jun 10 00:35:49.671266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.671245 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2q8pl\"" Jun 10 00:35:49.671378 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.671296 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 00:35:49.671459 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.671397 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 00:35:49.671542 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.671521 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 00:35:49.692867 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.692835 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:49.742280 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742249 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.742473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742293 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7c279e6-c0d0-468b-9940-45b25b385669-config-volume\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.742473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742319 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj2bl\" (UniqueName: \"kubernetes.io/projected/c7c279e6-c0d0-468b-9940-45b25b385669-kube-api-access-xj2bl\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.742473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742388 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa75d238-2f3d-43b8-9787-7c2b884152a0-cert\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.742473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742429 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c279e6-c0d0-468b-9940-45b25b385669-tmp-dir\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.742657 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.742483 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvdn\" (UniqueName: \"kubernetes.io/projected/aa75d238-2f3d-43b8-9787-7c2b884152a0-kube-api-access-mjvdn\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.786688 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.786560 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:49.843499 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843449 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843522 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7c279e6-c0d0-468b-9940-45b25b385669-config-volume\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843544 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj2bl\" (UniqueName: \"kubernetes.io/projected/c7c279e6-c0d0-468b-9940-45b25b385669-kube-api-access-xj2bl\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.843548 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843566 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa75d238-2f3d-43b8-9787-7c2b884152a0-cert\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843620 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c279e6-c0d0-468b-9940-45b25b385669-tmp-dir\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.843660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.843650 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvdn\" (UniqueName: \"kubernetes.io/projected/aa75d238-2f3d-43b8-9787-7c2b884152a0-kube-api-access-mjvdn\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.843970 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.843754 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:50.343717533 +0000 UTC m=+34.589176603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:35:49.844036 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.844021 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7c279e6-c0d0-468b-9940-45b25b385669-tmp-dir\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.844203 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.844177 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7c279e6-c0d0-468b-9940-45b25b385669-config-volume\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.848988 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.848968 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa75d238-2f3d-43b8-9787-7c2b884152a0-cert\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.853796 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.853719 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:49.856367 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.856345 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj2bl\" (UniqueName: \"kubernetes.io/projected/c7c279e6-c0d0-468b-9940-45b25b385669-kube-api-access-xj2bl\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:49.856493 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.856372 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvdn\" (UniqueName: \"kubernetes.io/projected/aa75d238-2f3d-43b8-9787-7c2b884152a0-kube-api-access-mjvdn\") pod \"ingress-canary-dkzjd\" (UID: \"aa75d238-2f3d-43b8-9787-7c2b884152a0\") " pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:49.944570 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.944533 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:49.944756 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.944702 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:49.944817 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:49.944785 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:21.944763263 +0000 UTC m=+66.190222326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:49.977858 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:49.977828 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkzjd" Jun 10 00:35:50.045999 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.045917 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:50.046158 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.046052 2521 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:50.046158 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.046135 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret podName:2b52f7c3-f3e8-4f8e-8e72-652281c1f826 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:22.046115326 +0000 UTC m=+66.291574395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret") pod "global-pull-secret-syncer-np6lm" (UID: "2b52f7c3-f3e8-4f8e-8e72-652281c1f826") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:50.147298 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.147266 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:50.147511 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.147450 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:50.147511 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.147482 2521 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:50.147511 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.147494 2521 projected.go:196] Error preparing data for projected volume kube-api-access-w89vz for pod openshift-network-diagnostics/network-check-target-vqsp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:50.147818 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.147561 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz podName:519fbeb8-2649-42c3-b561-c79637c171f6 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:22.147542116 +0000 UTC m=+66.393001189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w89vz" (UniqueName: "kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz") pod "network-check-target-vqsp9" (UID: "519fbeb8-2649-42c3-b561-c79637c171f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:50.349032 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.348857 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:50.349032 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.349027 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:50.349230 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:50.349120 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:51.349097372 +0000 UTC m=+35.594556435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:35:50.365708 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.365683 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6"] Jun 10 00:35:50.382499 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.382464 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58"] Jun 10 00:35:50.382661 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.382473 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.386390 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.386188 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 00:35:50.386390 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.386195 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 00:35:50.386390 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.386288 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 00:35:50.386636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.386582 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 00:35:50.390210 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:50.390182 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa75d238_2f3d_43b8_9787_7c2b884152a0.slice/crio-9f4a1acc6fe5ac2426079bf9af0dca8bb073ff153ce745003e0b086b67649bbf WatchSource:0}: Error finding container 9f4a1acc6fe5ac2426079bf9af0dca8bb073ff153ce745003e0b086b67649bbf: Status 404 returned error can't find the container with id 9f4a1acc6fe5ac2426079bf9af0dca8bb073ff153ce745003e0b086b67649bbf Jun 10 00:35:50.401103 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.401058 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6"] Jun 10 00:35:50.401190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.401102 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkzjd" event={"ID":"aa75d238-2f3d-43b8-9787-7c2b884152a0","Type":"ContainerStarted","Data":"9f4a1acc6fe5ac2426079bf9af0dca8bb073ff153ce745003e0b086b67649bbf"} Jun 10 00:35:50.401190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.401123 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkzjd"] Jun 10 00:35:50.401190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.401140 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58"] Jun 10 00:35:50.401309 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.401214 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.403901 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.403878 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 00:35:50.404035 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.403878 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 00:35:50.404096 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.404047 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 00:35:50.404153 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.404137 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 00:35:50.550720 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550687 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.550720 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550719 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx2qq\" (UniqueName: \"kubernetes.io/projected/b0339e47-250e-4e50-bcdc-348c35fb67ca-kube-api-access-cx2qq\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550762 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0339e47-250e-4e50-bcdc-348c35fb67ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550788 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550851 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550902 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7267b-54fc-4d76-b37a-ee2832b46ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550933 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0339e47-250e-4e50-bcdc-348c35fb67ca-tmp\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.550982 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.551377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.551011 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgj2\" (UniqueName: \"kubernetes.io/projected/53c7267b-54fc-4d76-b37a-ee2832b46ae6-kube-api-access-pvgj2\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.567723 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.567628 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:50.651606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651363 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651415 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgj2\" (UniqueName: \"kubernetes.io/projected/53c7267b-54fc-4d76-b37a-ee2832b46ae6-kube-api-access-pvgj2\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651500 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651556 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx2qq\" (UniqueName: \"kubernetes.io/projected/b0339e47-250e-4e50-bcdc-348c35fb67ca-kube-api-access-cx2qq\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.651893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651617 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0339e47-250e-4e50-bcdc-348c35fb67ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.651893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651652 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651687 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651716 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7267b-54fc-4d76-b37a-ee2832b46ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.651893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.651739 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0339e47-250e-4e50-bcdc-348c35fb67ca-tmp\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.652629 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.652412 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0339e47-250e-4e50-bcdc-348c35fb67ca-tmp\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.652629 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.652622 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7267b-54fc-4d76-b37a-ee2832b46ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.655225 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.655176 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b0339e47-250e-4e50-bcdc-348c35fb67ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.655454 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.655416 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.655534 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.655479 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-hub\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.655534 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.655479 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.655534 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.655481 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53c7267b-54fc-4d76-b37a-ee2832b46ae6-ca\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.660767 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.660724 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx2qq\" (UniqueName: \"kubernetes.io/projected/b0339e47-250e-4e50-bcdc-348c35fb67ca-kube-api-access-cx2qq\") pod \"klusterlet-addon-workmgr-6b69f479fc-d7pn6\" (UID: \"b0339e47-250e-4e50-bcdc-348c35fb67ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.660857 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.660800 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgj2\" (UniqueName: \"kubernetes.io/projected/53c7267b-54fc-4d76-b37a-ee2832b46ae6-kube-api-access-pvgj2\") pod \"cluster-proxy-proxy-agent-646cb8cbbd-rhh58\" (UID: \"53c7267b-54fc-4d76-b37a-ee2832b46ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.671096 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.671064 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:50.694515 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.694493 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:50.719158 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.719135 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:35:50.850506 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.850469 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6"] Jun 10 00:35:50.883858 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:50.883813 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0339e47_250e_4e50_bcdc_348c35fb67ca.slice/crio-8927f2a5ad360b2aa66e4d4781e26c5ee51b5a7b139129fb338381b4e4fee9f4 WatchSource:0}: Error finding container 8927f2a5ad360b2aa66e4d4781e26c5ee51b5a7b139129fb338381b4e4fee9f4: Status 404 returned error can't find the container with id 8927f2a5ad360b2aa66e4d4781e26c5ee51b5a7b139129fb338381b4e4fee9f4 Jun 10 00:35:50.988240 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:50.988207 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58"] Jun 10 00:35:50.993395 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:35:50.993351 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53c7267b_54fc_4d76_b37a_ee2832b46ae6.slice/crio-eb3c7e3e594139ad8adc5ae5f558ed1046f2e016e11cfaf147fd1a1b0ac390d5 WatchSource:0}: Error finding container eb3c7e3e594139ad8adc5ae5f558ed1046f2e016e11cfaf147fd1a1b0ac390d5: Status 404 returned error can't find the container with id eb3c7e3e594139ad8adc5ae5f558ed1046f2e016e11cfaf147fd1a1b0ac390d5 Jun 10 00:35:51.243942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.243858 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:35:51.244127 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.243858 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:35:51.244470 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.243867 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:35:51.247515 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.247422 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:35:51.247515 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.247507 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:35:51.249065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.248882 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:35:51.249065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.248917 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:35:51.249065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.248961 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:35:51.249065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.248922 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:35:51.357407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.357372 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:51.357643 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:51.357538 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:51.357711 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:51.357679 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:53.357654074 +0000 UTC m=+37.603113132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:35:51.401900 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.401866 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerStarted","Data":"eb3c7e3e594139ad8adc5ae5f558ed1046f2e016e11cfaf147fd1a1b0ac390d5"} Jun 10 00:35:51.402868 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.402841 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerStarted","Data":"8927f2a5ad360b2aa66e4d4781e26c5ee51b5a7b139129fb338381b4e4fee9f4"} Jun 10 00:35:51.405788 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.405765 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="3541999d2687ad4012bcfe0445b4242d2cb43b5058c760d3516519eb564726b7" exitCode=0 Jun 10 00:35:51.405891 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:51.405813 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"3541999d2687ad4012bcfe0445b4242d2cb43b5058c760d3516519eb564726b7"} Jun 10 00:35:52.412398 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:52.412361 2521 generic.go:356] "Generic (PLEG): container finished" podID="18800945-fb59-462f-8b55-11e825d11608" containerID="c17160355f42b5def39b63827684a895453d28102243ed79d7da8a9604197c01" exitCode=0 Jun 10 00:35:52.412918 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:52.412448 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerDied","Data":"c17160355f42b5def39b63827684a895453d28102243ed79d7da8a9604197c01"} Jun 10 00:35:52.714742 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:52.714475 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:52.815560 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:52.815378 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:53.141572 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.141514 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:53.241337 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.241252 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:53.377106 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.376983 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:53.377291 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:53.377121 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:53.377291 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:53.377188 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:57.377168499 +0000 UTC m=+41.622627570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:35:53.420227 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.420136 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" event={"ID":"18800945-fb59-462f-8b55-11e825d11608","Type":"ContainerStarted","Data":"b26b8637cda122591c970adf1f842284a458b8db54358eb1205de9b61e3ea707"} Jun 10 00:35:53.447739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.447399 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vrkkw" podStartSLOduration=7.950277386 podStartE2EDuration="37.447376503s" totalImagesPullingTime="29.497099117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:53.445676523 +0000 UTC m=+37.691135635" watchObservedRunningTime="2026-06-10 00:35:53.447376503 +0000 UTC m=+37.692835584" Jun 10 00:35:53.574400 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.574344 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:53.636751 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:53.636711 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:54.042309 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:54.042194 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:54.425213 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:54.425173 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkzjd" event={"ID":"aa75d238-2f3d-43b8-9787-7c2b884152a0","Type":"ContainerStarted","Data":"9bbb40addf6eecde2eb3a4fdf09e28c1210b2fa501259933333c8cbc920c6237"} Jun 10 00:35:54.443273 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:54.443215 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dkzjd" podStartSLOduration=2.079533646 podStartE2EDuration="5.44319547s" totalImagesPullingTime="3.363661824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:54.442768948 +0000 UTC m=+38.688228027" watchObservedRunningTime="2026-06-10 00:35:54.44319547 +0000 UTC m=+38.688654550" Jun 10 00:35:56.015466 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:56.015407 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:56.134457 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:56.134394 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:56.803738 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:56.803701 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:56.862638 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:56.862600 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:35:57.414571 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.414545 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:35:57.414840 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:57.414673 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:57.414840 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:35:57.414731 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:05.414714341 +0000 UTC m=+49.660173398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:35:57.434242 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.434203 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerStarted","Data":"42a00695d57c7fef1904ee50bba53fe936110eff0713d40aab815a15e71efff5"} Jun 10 00:35:57.436331 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.436297 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerStarted","Data":"e8c86b79b636353db542d347f7d01fd31b0b61d49648fa415f3eed45fe46d9ab"} Jun 10 00:35:57.436538 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.436522 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:57.437896 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.437861 2521 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" podUID="b0339e47-250e-4e50-bcdc-348c35fb67ca" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 10 00:35:57.456997 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:57.456943 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" podStartSLOduration=1.032523476 podStartE2EDuration="7.456925959s" totalImagesPullingTime="6.424402483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:57.456396584 +0000 UTC m=+41.701855678" watchObservedRunningTime="2026-06-10 00:35:57.456925959 +0000 UTC m=+41.702385016" Jun 10 00:35:58.441106 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:58.441073 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerStarted","Data":"bdf0e42bda187111665d728620c4cd0d936632648ed02f395595bc116c849621"} Jun 10 00:35:58.441541 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:58.441120 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerStarted","Data":"4ce65b6d23edaa3342c079c53a107f10bf0c481fa7581c087edbdbbeb36f13d0"} Jun 10 00:35:58.442346 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:58.442325 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:35:58.466045 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:35:58.466001 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" podStartSLOduration=2.136516344 podStartE2EDuration="8.465988471s" totalImagesPullingTime="6.329472127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:58.464247139 +0000 UTC m=+42.709706215" watchObservedRunningTime="2026-06-10 00:35:58.465988471 +0000 UTC m=+42.711447550" Jun 10 00:36:01.277840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:01.277805 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:01.360830 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:01.360802 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:03.642705 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:03.642677 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:03.740610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:03.740580 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:05.477177 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:05.477148 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:36:05.477572 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:05.477303 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:05.477572 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:05.477367 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:21.477351335 +0000 UTC m=+65.722810392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:36:06.098352 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:06.098319 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:06.158950 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:06.158920 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:14.013012 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:14.012973 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:14.067248 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:14.067213 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:17.399744 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:17.399717 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znzd6" Jun 10 00:36:17.562426 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:17.562389 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:17.655665 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:17.655574 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:21.488968 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:21.488926 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:36:21.489475 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:21.489105 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:21.489475 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:21.489201 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:53.489178551 +0000 UTC m=+97.734637612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:36:21.993611 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:21.993572 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:36:21.996715 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:21.996694 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:36:22.004273 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:22.004253 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:36:22.004361 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:22.004334 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:26.004311224 +0000 UTC m=+130.249770282 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : secret "metrics-daemon-secret" not found Jun 10 00:36:22.094314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.094271 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:36:22.097517 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.097499 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:36:22.107930 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.107901 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b52f7c3-f3e8-4f8e-8e72-652281c1f826-original-pull-secret\") pod \"global-pull-secret-syncer-np6lm\" (UID: \"2b52f7c3-f3e8-4f8e-8e72-652281c1f826\") " pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:36:22.170841 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.170808 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np6lm" Jun 10 00:36:22.195287 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.195252 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:36:22.198556 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.198536 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:36:22.208408 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.208384 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:36:22.219128 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.219107 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89vz\" (UniqueName: \"kubernetes.io/projected/519fbeb8-2649-42c3-b561-c79637c171f6-kube-api-access-w89vz\") pod \"network-check-target-vqsp9\" (UID: \"519fbeb8-2649-42c3-b561-c79637c171f6\") " pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:36:22.334871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.334835 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-np6lm"] Jun 10 00:36:22.337495 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:36:22.337461 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b52f7c3_f3e8_4f8e_8e72_652281c1f826.slice/crio-7dea91f7c6b949a9b8ef4c5ecdde1e8d73a6857a32e9c000e11042400d3e1e70 WatchSource:0}: Error finding container 7dea91f7c6b949a9b8ef4c5ecdde1e8d73a6857a32e9c000e11042400d3e1e70: Status 404 returned error can't find the container with id 7dea91f7c6b949a9b8ef4c5ecdde1e8d73a6857a32e9c000e11042400d3e1e70 Jun 10 00:36:22.467793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.467758 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:36:22.475416 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.475393 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:36:22.499993 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.499961 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-np6lm" event={"ID":"2b52f7c3-f3e8-4f8e-8e72-652281c1f826","Type":"ContainerStarted","Data":"7dea91f7c6b949a9b8ef4c5ecdde1e8d73a6857a32e9c000e11042400d3e1e70"} Jun 10 00:36:22.624210 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:22.624180 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqsp9"] Jun 10 00:36:22.627289 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:36:22.627265 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519fbeb8_2649_42c3_b561_c79637c171f6.slice/crio-04bcca648f398bc4c45281202f2317784b7efabd789d3dab1b6efbd4383614b2 WatchSource:0}: Error finding container 04bcca648f398bc4c45281202f2317784b7efabd789d3dab1b6efbd4383614b2: Status 404 returned error can't find the container with id 04bcca648f398bc4c45281202f2317784b7efabd789d3dab1b6efbd4383614b2 Jun 10 00:36:23.504822 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:23.504779 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqsp9" event={"ID":"519fbeb8-2649-42c3-b561-c79637c171f6","Type":"ContainerStarted","Data":"04bcca648f398bc4c45281202f2317784b7efabd789d3dab1b6efbd4383614b2"} Jun 10 00:36:27.518255 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:27.518222 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqsp9" event={"ID":"519fbeb8-2649-42c3-b561-c79637c171f6","Type":"ContainerStarted","Data":"565206e308f343f55ee2040eebb8cbab61f6780e49709fe62f43053ca2c22ac6"} Jun 10 00:36:27.518681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:27.518315 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:36:27.538178 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:27.538130 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vqsp9" podStartSLOduration=66.857804434 podStartE2EDuration="1m11.538117207s" totalImagesPullingTime="4.680312773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:27.537646295 +0000 UTC m=+71.783105376" watchObservedRunningTime="2026-06-10 00:36:27.538117207 +0000 UTC m=+71.783576286" Jun 10 00:36:27.604169 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:27.604083 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:27.706387 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:27.706351 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:36:28.522313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:28.522281 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-np6lm" event={"ID":"2b52f7c3-f3e8-4f8e-8e72-652281c1f826","Type":"ContainerStarted","Data":"d9b060e8ff0247b9e9de8bcbca9d113f26929df07a41c5ea60b460ae4b7d0246"} Jun 10 00:36:28.538794 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:28.538745 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-np6lm" podStartSLOduration=67.231667645 podStartE2EDuration="1m12.538727859s" totalImagesPullingTime="5.307060214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:28.538334289 +0000 UTC m=+72.783793368" watchObservedRunningTime="2026-06-10 00:36:28.538727859 +0000 UTC m=+72.784186937" Jun 10 00:36:53.513835 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:53.513795 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:36:53.514242 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:53.513946 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:53.514242 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:36:53.514026 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.514010172 +0000 UTC m=+161.759469229 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:36:58.525211 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:36:58.525176 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vqsp9" Jun 10 00:37:26.034048 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:26.034004 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:37:26.034515 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:26.034158 2521 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:37:26.034515 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:26.034231 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs podName:e204723b-797e-42f4-beb4-2dd1f95805c8 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:28.034213621 +0000 UTC m=+252.279672678 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs") pod "network-metrics-daemon-xbhcm" (UID: "e204723b-797e-42f4-beb4-2dd1f95805c8") : secret "metrics-daemon-secret" not found Jun 10 00:37:34.613940 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:34.613900 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:52.662968 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:52.662921 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cv84d" podUID="c7c279e6-c0d0-468b-9940-45b25b385669" Jun 10 00:37:52.761856 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:52.761825 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cv84d" Jun 10 00:37:54.255783 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:54.255737 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xbhcm" podUID="e204723b-797e-42f4-beb4-2dd1f95805c8" Jun 10 00:37:56.023623 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:56.023590 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:56.123692 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:56.123645 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:57.563250 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.563210 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:37:57.563641 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:57.563373 2521 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:37:57.563641 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:37:57.563465 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls podName:c7c279e6-c0d0-468b-9940-45b25b385669 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:59.563425202 +0000 UTC m=+283.808884259 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls") pod "dns-default-cv84d" (UID: "c7c279e6-c0d0-468b-9940-45b25b385669") : secret "dns-default-metrics-tls" not found Jun 10 00:37:57.777561 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.777473 2521 generic.go:356] "Generic (PLEG): container finished" podID="b0339e47-250e-4e50-bcdc-348c35fb67ca" containerID="e8c86b79b636353db542d347f7d01fd31b0b61d49648fa415f3eed45fe46d9ab" exitCode=1 Jun 10 00:37:57.777561 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.777535 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerDied","Data":"e8c86b79b636353db542d347f7d01fd31b0b61d49648fa415f3eed45fe46d9ab"} Jun 10 00:37:57.777830 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.777816 2521 scope.go:117] "RemoveContainer" containerID="e8c86b79b636353db542d347f7d01fd31b0b61d49648fa415f3eed45fe46d9ab" Jun 10 00:37:57.869869 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.869835 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:57.970370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:57.970338 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:58.442052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.441997 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:37:58.782583 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.782493 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerStarted","Data":"9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d"} Jun 10 00:37:58.783006 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.782703 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:37:58.783326 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.783308 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:37:58.910723 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.910694 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:37:58.962308 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:37:58.962279 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:00.823266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:00.823172 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ck45j_039c063d-1d7c-467b-8ef5-9e468078a18c/dns-node-resolver/0.log" Jun 10 00:38:01.308798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.308768 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.357754 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.357720 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.551026 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.550992 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.631607 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.631529 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.691910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.691869 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.785562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.785530 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:01.820250 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:01.820221 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9zpt_b569054a-1cb2-46cb-bcc6-99f6ff515e79/node-ca/0.log" Jun 10 00:38:02.020513 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:02.020405 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:02.123208 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:02.123169 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:02.821123 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:02.821095 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkzjd_aa75d238-2f3d-43b8-9787-7c2b884152a0/serve-healthcheck-canary/0.log" Jun 10 00:38:03.721791 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:03.721759 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:03.767952 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:03.767920 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:03.903770 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:03.903739 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:04.702657 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:04.702623 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:06.984509 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:06.984467 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:07.908831 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:07.908797 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.039359 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.039323 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.140982 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.140932 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.240627 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.240512 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.301709 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.301668 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.361838 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.361806 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:08.804343 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:08.804310 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:09.244658 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:09.244571 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:38:09.605783 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:09.605752 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:09.806452 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:09.806400 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:10.206535 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:10.206490 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:10.406289 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:10.406252 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:10.812692 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:10.812658 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:11.304793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:11.304755 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:11.406722 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:11.406689 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:11.805590 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:11.805555 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:11.856495 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:11.856459 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:11.920777 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:11.920737 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:12.208645 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:12.208549 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:12.404155 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:12.404117 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:12.805071 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:12.805040 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:13.207164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:13.207073 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:13.807607 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:13.807573 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:14.204762 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:14.204667 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:14.408466 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:14.408425 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:14.658126 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:14.658091 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:14.808307 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:14.808278 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:15.406171 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:15.406138 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:15.820395 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:15.820358 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:16.013010 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:16.012979 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:16.569214 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:16.569182 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:16.669362 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:16.669329 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:17.010118 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:17.010016 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:17.411531 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:17.411491 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:17.813899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:17.813859 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:18.213683 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:18.213588 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:18.409928 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:18.409897 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:18.610022 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:18.609978 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:18.820829 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:18.820780 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:18.925063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:18.924979 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.304946 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.304908 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.355020 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.354985 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.492577 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.492536 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.537671 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.537636 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.894505 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.894467 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:19.939340 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:19.939307 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:20.708815 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:20.708772 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:21.661694 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:21.661650 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:22.322512 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.322478 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xwkhl"] Jun 10 00:38:22.325644 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.325624 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.329121 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.329095 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 00:38:22.329365 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.329347 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l2vh\"" Jun 10 00:38:22.330220 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.330198 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 00:38:22.330330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.330197 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 00:38:22.330816 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.330795 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 00:38:22.345899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.345873 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwkhl"] Jun 10 00:38:22.352912 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.352888 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09504e20-8ab9-4e8f-9440-ed7d30f8474e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.353036 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.352950 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09504e20-8ab9-4e8f-9440-ed7d30f8474e-crio-socket\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.353036 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.353012 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09504e20-8ab9-4e8f-9440-ed7d30f8474e-data-volume\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.353112 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.353082 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.353112 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.353100 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvr8m\" (UniqueName: \"kubernetes.io/projected/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-api-access-cvr8m\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.414324 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.414292 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:22.454039 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454012 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454181 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454045 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvr8m\" (UniqueName: \"kubernetes.io/projected/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-api-access-cvr8m\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454181 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454071 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09504e20-8ab9-4e8f-9440-ed7d30f8474e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454288 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454249 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09504e20-8ab9-4e8f-9440-ed7d30f8474e-crio-socket\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454339 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454287 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09504e20-8ab9-4e8f-9440-ed7d30f8474e-data-volume\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454407 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454385 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09504e20-8ab9-4e8f-9440-ed7d30f8474e-crio-socket\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454593 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09504e20-8ab9-4e8f-9440-ed7d30f8474e-data-volume\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.454735 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.454712 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.456354 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.456336 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09504e20-8ab9-4e8f-9440-ed7d30f8474e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.465199 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.465171 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvr8m\" (UniqueName: \"kubernetes.io/projected/09504e20-8ab9-4e8f-9440-ed7d30f8474e-kube-api-access-cvr8m\") pod \"insights-runtime-extractor-xwkhl\" (UID: \"09504e20-8ab9-4e8f-9440-ed7d30f8474e\") " pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.514288 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.514253 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:22.634176 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.634092 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwkhl" Jun 10 00:38:22.763864 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.763731 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwkhl"] Jun 10 00:38:22.766656 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:22.766630 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09504e20_8ab9_4e8f_9440_ed7d30f8474e.slice/crio-9ea71274100c9f6731b8708359afd7a9b9e0d0114e9d987f7f993fd2892e56f4 WatchSource:0}: Error finding container 9ea71274100c9f6731b8708359afd7a9b9e0d0114e9d987f7f993fd2892e56f4: Status 404 returned error can't find the container with id 9ea71274100c9f6731b8708359afd7a9b9e0d0114e9d987f7f993fd2892e56f4 Jun 10 00:38:22.855571 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.855539 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwkhl" event={"ID":"09504e20-8ab9-4e8f-9440-ed7d30f8474e","Type":"ContainerStarted","Data":"a1f08ca7aca7a685e296569621ec424e176c36f719081d45aec700785e5f504e"} Jun 10 00:38:22.855718 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:22.855595 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwkhl" event={"ID":"09504e20-8ab9-4e8f-9440-ed7d30f8474e","Type":"ContainerStarted","Data":"9ea71274100c9f6731b8708359afd7a9b9e0d0114e9d987f7f993fd2892e56f4"} Jun 10 00:38:23.860254 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:23.860171 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwkhl" event={"ID":"09504e20-8ab9-4e8f-9440-ed7d30f8474e","Type":"ContainerStarted","Data":"c79cf06dd3185b3acefadca8ca2278d6bf78a5f08813981c1d4595364b7ad093"} Jun 10 00:38:24.322164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:24.322131 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:25.869411 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:25.869376 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwkhl" event={"ID":"09504e20-8ab9-4e8f-9440-ed7d30f8474e","Type":"ContainerStarted","Data":"5724fcd2cdf8b3bcd00065edf9662a31f06ae23926ca2ee2d4ee0091fced03ea"} Jun 10 00:38:25.886148 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:25.886101 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xwkhl" podStartSLOduration=1.401061404 podStartE2EDuration="3.88608289s" totalImagesPullingTime="2.485021486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:25.885776262 +0000 UTC m=+190.131235353" watchObservedRunningTime="2026-06-10 00:38:25.88608289 +0000 UTC m=+190.131541970" Jun 10 00:38:30.657960 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:30.657922 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:30.760992 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:30.760949 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:30.830226 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:30.830186 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:31.019745 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:31.019660 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:31.121214 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:31.121177 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:31.221642 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:31.221606 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:31.272083 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:31.271999 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:31.925102 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:31.925062 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:32.026404 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:32.026375 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:33.840296 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:33.840262 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:33.900176 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:33.900142 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:33.956797 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:33.956766 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:34.056884 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.056850 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:34.937901 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.937870 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:38:34.940655 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.940640 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:34.943380 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.943355 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 00:38:34.943380 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.943379 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 00:38:34.944671 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944649 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q9p89\"" Jun 10 00:38:34.944812 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944675 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 00:38:34.944812 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944756 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 00:38:34.944945 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944873 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 00:38:34.944945 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944938 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 00:38:34.945043 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.944940 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 00:38:34.949597 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:34.949577 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:38:35.049056 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049023 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.049056 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049059 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.049279 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049077 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.049279 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049092 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.049279 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049172 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.049279 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.049208 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150528 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150495 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150535 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150552 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150568 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150741 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150613 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.150808 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.150787 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.151329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.151304 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.151329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.151320 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.151536 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.151304 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.153065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.153037 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.153160 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.153039 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.159228 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.159210 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr\") pod \"console-7f688df7f6-rs2zz\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.250317 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.250238 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:35.371402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.371374 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:38:35.373990 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:35.373957 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5bc582_5735_4b5b_827a_19addeb03580.slice/crio-1a7fe452d8b15477ba225e59029e931ccb6e39d58ec167c89803f9cf5c22acb7 WatchSource:0}: Error finding container 1a7fe452d8b15477ba225e59029e931ccb6e39d58ec167c89803f9cf5c22acb7: Status 404 returned error can't find the container with id 1a7fe452d8b15477ba225e59029e931ccb6e39d58ec167c89803f9cf5c22acb7 Jun 10 00:38:35.897180 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.897146 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f688df7f6-rs2zz" event={"ID":"af5bc582-5735-4b5b-827a-19addeb03580","Type":"ContainerStarted","Data":"1a7fe452d8b15477ba225e59029e931ccb6e39d58ec167c89803f9cf5c22acb7"} Jun 10 00:38:35.921158 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:35.921116 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:36.022223 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:36.022191 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:36.151848 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:36.151757 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:37.720665 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:37.720625 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:37.821642 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:37.821598 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:37.986602 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:37.986516 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.195309 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.195271 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.226381 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.226348 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z8gwp"] Jun 10 00:38:38.229897 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.229875 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.232863 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.232834 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 00:38:38.233002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.232834 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 00:38:38.233002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.232847 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5gdb\"" Jun 10 00:38:38.233119 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.233045 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 00:38:38.234324 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.234300 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 00:38:38.234430 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.234310 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 00:38:38.234430 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.234334 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 00:38:38.275165 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275057 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275248 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-metrics-client-ca\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275288 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-wtmp\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275336 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-root\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275423 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-textfile\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275480 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275514 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-sys\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275538 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.275587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.275563 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm8h5\" (UniqueName: \"kubernetes.io/projected/aa8e0597-98d4-4f37-8e00-3815d57912d2-kube-api-access-xm8h5\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.282868 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.282836 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.338221 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.338184 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.376983 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.376945 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-metrics-client-ca\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377167 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377014 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-wtmp\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377167 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377063 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-root\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377167 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377119 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-textfile\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377347 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377185 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-wtmp\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377347 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377262 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-root\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377469 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377371 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377469 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377409 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-textfile\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377469 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377424 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-sys\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377484 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa8e0597-98d4-4f37-8e00-3815d57912d2-sys\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377488 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377521 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm8h5\" (UniqueName: \"kubernetes.io/projected/aa8e0597-98d4-4f37-8e00-3815d57912d2-kube-api-access-xm8h5\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377562 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377574 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-metrics-client-ca\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.377853 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:38:38.377666 2521 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.377853 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:38:38.377725 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls podName:aa8e0597-98d4-4f37-8e00-3815d57912d2 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:38.877704443 +0000 UTC m=+203.123163506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls") pod "node-exporter-z8gwp" (UID: "aa8e0597-98d4-4f37-8e00-3815d57912d2") : secret "node-exporter-tls" not found Jun 10 00:38:38.377969 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.377849 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.380156 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.380133 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.388033 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.388006 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm8h5\" (UniqueName: \"kubernetes.io/projected/aa8e0597-98d4-4f37-8e00-3815d57912d2-kube-api-access-xm8h5\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.436927 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.436890 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.591365 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.591325 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.666757 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.666721 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.729271 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.729226 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.864498 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.864411 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:38.881729 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:38.881704 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:38.881878 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:38:38.881853 2521 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.881936 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:38:38.881924 2521 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls podName:aa8e0597-98d4-4f37-8e00-3815d57912d2 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:39.881909072 +0000 UTC m=+204.127368129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls") pod "node-exporter-z8gwp" (UID: "aa8e0597-98d4-4f37-8e00-3815d57912d2") : secret "node-exporter-tls" not found Jun 10 00:38:39.131395 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.131301 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:39.230347 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.230313 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:39.297566 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.297532 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:39.438696 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.438606 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:39.890464 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.890404 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:39.892719 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.892691 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa8e0597-98d4-4f37-8e00-3815d57912d2-node-exporter-tls\") pod \"node-exporter-z8gwp\" (UID: \"aa8e0597-98d4-4f37-8e00-3815d57912d2\") " pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:39.911321 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.911291 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f688df7f6-rs2zz" event={"ID":"af5bc582-5735-4b5b-827a-19addeb03580","Type":"ContainerStarted","Data":"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620"} Jun 10 00:38:39.926809 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:39.926750 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f688df7f6-rs2zz" podStartSLOduration=2.417166009 podStartE2EDuration="5.926732218s" totalImagesPullingTime="3.509566209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:39.926487113 +0000 UTC m=+204.171946189" watchObservedRunningTime="2026-06-10 00:38:39.926732218 +0000 UTC m=+204.172191300" Jun 10 00:38:40.041767 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.041718 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z8gwp" Jun 10 00:38:40.053648 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:40.053615 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8e0597_98d4_4f37_8e00_3815d57912d2.slice/crio-c7bb168dbdca6175016e98d6823ac096832333a5b39cdf4e2b4a38459e79367f WatchSource:0}: Error finding container c7bb168dbdca6175016e98d6823ac096832333a5b39cdf4e2b4a38459e79367f: Status 404 returned error can't find the container with id c7bb168dbdca6175016e98d6823ac096832333a5b39cdf4e2b4a38459e79367f Jun 10 00:38:40.524018 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.523951 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:40.576827 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.576791 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:40.721191 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.721151 2521 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" podUID="53c7267b-54fc-4d76-b37a-ee2832b46ae6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 00:38:40.921400 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.921367 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gwp" event={"ID":"aa8e0597-98d4-4f37-8e00-3815d57912d2","Type":"ContainerStarted","Data":"50f58653e479a81e18b5fbf61cacbaa69409cca9f59751f6f43eb991b2137cdd"} Jun 10 00:38:40.921899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:40.921463 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gwp" event={"ID":"aa8e0597-98d4-4f37-8e00-3815d57912d2","Type":"ContainerStarted","Data":"c7bb168dbdca6175016e98d6823ac096832333a5b39cdf4e2b4a38459e79367f"} Jun 10 00:38:41.126740 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.126659 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:38:41.128383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.128368 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.136458 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.136412 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 00:38:41.140233 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.140211 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:38:41.169012 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.168983 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:41.200681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200646 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200684 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200708 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkgcq\" (UniqueName: \"kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200799 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200821 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200848 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.200871 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.200862 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.270646 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.270612 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:41.301313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301285 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301314 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301342 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301357 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301385 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301411 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.301928 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.301878 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkgcq\" (UniqueName: \"kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.302148 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.302083 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.302262 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.302188 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.302262 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.302197 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.302262 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.302236 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.303984 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.303963 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.303984 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.303975 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.310314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.310289 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkgcq\" (UniqueName: \"kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq\") pod \"console-6475885df6-4x9xw\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.370218 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.370186 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:41.419110 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.419033 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:41.437961 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.437925 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:41.558862 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.558838 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:38:41.560715 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:41.560688 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c48a643_051c_4e66_8308_ea10e6b0ee44.slice/crio-e94b2211dd6475d1d79d39ade34e3a9d1abd24f6641134c8624bc6bc085d4aeb WatchSource:0}: Error finding container e94b2211dd6475d1d79d39ade34e3a9d1abd24f6641134c8624bc6bc085d4aeb: Status 404 returned error can't find the container with id e94b2211dd6475d1d79d39ade34e3a9d1abd24f6641134c8624bc6bc085d4aeb Jun 10 00:38:41.925979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.925946 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475885df6-4x9xw" event={"ID":"3c48a643-051c-4e66-8308-ea10e6b0ee44","Type":"ContainerStarted","Data":"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4"} Jun 10 00:38:41.926469 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.926002 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475885df6-4x9xw" event={"ID":"3c48a643-051c-4e66-8308-ea10e6b0ee44","Type":"ContainerStarted","Data":"e94b2211dd6475d1d79d39ade34e3a9d1abd24f6641134c8624bc6bc085d4aeb"} Jun 10 00:38:41.927496 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.927471 2521 generic.go:356] "Generic (PLEG): container finished" podID="aa8e0597-98d4-4f37-8e00-3815d57912d2" containerID="50f58653e479a81e18b5fbf61cacbaa69409cca9f59751f6f43eb991b2137cdd" exitCode=0 Jun 10 00:38:41.927608 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.927506 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gwp" event={"ID":"aa8e0597-98d4-4f37-8e00-3815d57912d2","Type":"ContainerDied","Data":"50f58653e479a81e18b5fbf61cacbaa69409cca9f59751f6f43eb991b2137cdd"} Jun 10 00:38:41.943303 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:41.943259 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6475885df6-4x9xw" podStartSLOduration=0.943241572 podStartE2EDuration="943.241572ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:41.942579018 +0000 UTC m=+206.188038097" watchObservedRunningTime="2026-06-10 00:38:41.943241572 +0000 UTC m=+206.188700689" Jun 10 00:38:42.932480 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:42.932427 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gwp" event={"ID":"aa8e0597-98d4-4f37-8e00-3815d57912d2","Type":"ContainerStarted","Data":"927564c9b633b9786cee34c949a65ce839a4a4e61584cedf9395547f30276a9d"} Jun 10 00:38:42.932891 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:42.932501 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z8gwp" event={"ID":"aa8e0597-98d4-4f37-8e00-3815d57912d2","Type":"ContainerStarted","Data":"2f64b06ad789e775aa7b798d87e17bdb15330793aa61645aff2424d912b826a7"} Jun 10 00:38:42.995704 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:42.995668 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:43.095373 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.095332 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:43.405644 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.405591 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z8gwp" podStartSLOduration=4.553234876 podStartE2EDuration="5.405575397s" totalImagesPullingTime="784.71314ms" totalInitContainerRuntime="67.627381ms" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:42.959281111 +0000 UTC m=+207.204740191" watchObservedRunningTime="2026-06-10 00:38:43.405575397 +0000 UTC m=+207.651034475" Jun 10 00:38:43.406090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.406061 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b98b58c44-x9gft"] Jun 10 00:38:43.408084 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.408069 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.411063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411039 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 00:38:43.411205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411077 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 00:38:43.411205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411101 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 00:38:43.411205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411129 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 00:38:43.411205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411113 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k5ztw\"" Jun 10 00:38:43.411205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.411101 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 00:38:43.416419 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.416396 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 00:38:43.418644 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.418624 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b98b58c44-x9gft"] Jun 10 00:38:43.520914 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.520877 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-telemeter-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521006 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521041 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521059 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg9b2\" (UniqueName: \"kubernetes.io/projected/343a3496-d351-4570-ac74-df59347741ff-kube-api-access-rg9b2\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521083 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-metrics-client-ca\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521284 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521100 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-serving-certs-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521284 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521141 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-federate-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.521284 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.521180 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622373 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622330 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622594 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622487 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622594 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622521 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg9b2\" (UniqueName: \"kubernetes.io/projected/343a3496-d351-4570-ac74-df59347741ff-kube-api-access-rg9b2\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622594 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622545 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-metrics-client-ca\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622768 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622659 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-serving-certs-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622768 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622700 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-federate-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.622938 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622877 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.623007 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.622938 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-telemeter-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.623282 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.623254 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-metrics-client-ca\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.623660 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.623633 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-serving-certs-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.623827 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.623801 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/343a3496-d351-4570-ac74-df59347741ff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.625065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.625034 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.625147 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.625112 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-federate-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.625220 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.625203 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-telemeter-client-tls\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.625256 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.625238 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/343a3496-d351-4570-ac74-df59347741ff-secret-telemeter-client\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.629729 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.629711 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg9b2\" (UniqueName: \"kubernetes.io/projected/343a3496-d351-4570-ac74-df59347741ff-kube-api-access-rg9b2\") pod \"telemeter-client-7b98b58c44-x9gft\" (UID: \"343a3496-d351-4570-ac74-df59347741ff\") " pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.717103 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.717014 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" Jun 10 00:38:43.809214 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.809177 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:43.840498 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.840468 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b98b58c44-x9gft"] Jun 10 00:38:43.843387 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:43.843350 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343a3496_d351_4570_ac74_df59347741ff.slice/crio-8ca9f83cc9298571d4823298fed222587ba72bf079f5cbe6dfa4462ac77c069e WatchSource:0}: Error finding container 8ca9f83cc9298571d4823298fed222587ba72bf079f5cbe6dfa4462ac77c069e: Status 404 returned error can't find the container with id 8ca9f83cc9298571d4823298fed222587ba72bf079f5cbe6dfa4462ac77c069e Jun 10 00:38:43.937336 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:43.937303 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" event={"ID":"343a3496-d351-4570-ac74-df59347741ff","Type":"ContainerStarted","Data":"8ca9f83cc9298571d4823298fed222587ba72bf079f5cbe6dfa4462ac77c069e"} Jun 10 00:38:44.142552 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.142516 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:44.148626 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.148598 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:38:44.212326 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.212290 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:44.442747 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.442665 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:38:44.445271 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.445248 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.446990 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.446955 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:44.448330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448030 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 00:38:44.448330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448032 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 00:38:44.448330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448053 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 00:38:44.448330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448303 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 00:38:44.448636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448346 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 00:38:44.448636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448403 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66jfd\"" Jun 10 00:38:44.448726 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448703 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 00:38:44.448726 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448719 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 00:38:44.448955 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448935 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 00:38:44.448955 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448946 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9dakcchavt7ma\"" Jun 10 00:38:44.449127 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.448935 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 00:38:44.449829 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.449808 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 00:38:44.449955 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.449830 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 00:38:44.449955 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.449861 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 00:38:44.450171 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.450144 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 00:38:44.450230 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.450144 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 00:38:44.452627 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.452604 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 00:38:44.474702 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.474668 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:38:44.531719 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531652 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531719 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531711 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531741 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531767 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531793 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbqn\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531821 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531892 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.531970 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531960 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.531983 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532003 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532042 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532068 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532099 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532132 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532159 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532193 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532230 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532250 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532657 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532361 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.532657 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.532389 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633011 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633052 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633070 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633087 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633116 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633144 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633172 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633291 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633347 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633374 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633398 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633414 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633499 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633528 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633571 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.633622 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633611 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633639 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633662 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633689 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbqn\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633719 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633965 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.633977 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634290 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.634274 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.634345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.634275 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.636048 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.636016 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.636391 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.636268 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.636802 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.636771 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.636802 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.636792 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.637074 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.637020 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.637151 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.637128 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.637414 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.637391 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.637516 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.637504 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.638902 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.638849 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.638995 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.638920 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.639114 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.639088 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.639200 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.639176 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.639278 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.639198 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.640274 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.640251 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.640351 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.640332 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.646761 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.646740 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbqn\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn\") pod \"prometheus-k8s-0\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.757921 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.757830 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:44.889282 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.889255 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:38:44.891323 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:38:44.891292 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa32913_ae91_4933_a185_41d0aa28f52a.slice/crio-dacf9ec7ebb422a10ad67988173294d1e9aa50e9c6a994e30783ab5ac184fa79 WatchSource:0}: Error finding container dacf9ec7ebb422a10ad67988173294d1e9aa50e9c6a994e30783ab5ac184fa79: Status 404 returned error can't find the container with id dacf9ec7ebb422a10ad67988173294d1e9aa50e9c6a994e30783ab5ac184fa79 Jun 10 00:38:44.941923 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:44.941886 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"dacf9ec7ebb422a10ad67988173294d1e9aa50e9c6a994e30783ab5ac184fa79"} Jun 10 00:38:45.250807 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:45.250777 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:38:45.947109 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:45.947072 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" event={"ID":"343a3496-d351-4570-ac74-df59347741ff","Type":"ContainerStarted","Data":"51427968dfa4990edaf53167d701144b7798a4fdafb43210f055e15eb2137a85"} Jun 10 00:38:46.951586 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:46.951553 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" exitCode=0 Jun 10 00:38:46.952014 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:46.951645 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} Jun 10 00:38:46.953803 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:46.953780 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" event={"ID":"343a3496-d351-4570-ac74-df59347741ff","Type":"ContainerStarted","Data":"85fc95fad570b01c9caff36bfbb97e1dc1d55d03182a5ec67d2959e8d2059019"} Jun 10 00:38:46.953885 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:46.953832 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" event={"ID":"343a3496-d351-4570-ac74-df59347741ff","Type":"ContainerStarted","Data":"5743b1a54c915b8060a8fade38befea71f1f27ce26524481d25ac62e4eeec346"} Jun 10 00:38:46.997750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:46.997702 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b98b58c44-x9gft" podStartSLOduration=1.682154022 podStartE2EDuration="3.997685845s" totalImagesPullingTime="2.315531823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:46.995815352 +0000 UTC m=+211.241274431" watchObservedRunningTime="2026-06-10 00:38:46.997685845 +0000 UTC m=+211.243144925" Jun 10 00:38:47.089029 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:47.088992 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:38:47.942042 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:47.942008 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:47.994739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:47.994691 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:50.720320 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:50.720284 2521 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" podUID="53c7267b-54fc-4d76-b37a-ee2832b46ae6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 00:38:50.970130 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:50.970103 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} Jun 10 00:38:51.438515 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:51.438487 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:38:51.980269 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:51.980234 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} Jun 10 00:38:53.991105 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:53.991022 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} Jun 10 00:38:53.991105 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:53.991083 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} Jun 10 00:38:53.991105 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:53.991109 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} Jun 10 00:38:53.991562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:53.991133 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerStarted","Data":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} Jun 10 00:38:54.018868 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:54.018786 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.109795502 podStartE2EDuration="10.018766654s" totalImagesPullingTime="7.885000611s" totalInitContainerRuntime="23.970541ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:54.016381736 +0000 UTC m=+218.261840819" watchObservedRunningTime="2026-06-10 00:38:54.018766654 +0000 UTC m=+218.264225735" Jun 10 00:38:54.758279 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:54.758243 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:38:57.595123 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:57.595078 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:57.650066 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:57.650034 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:59.113676 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:59.113642 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:38:59.214356 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:38:59.214319 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:00.720276 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:00.720241 2521 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" podUID="53c7267b-54fc-4d76-b37a-ee2832b46ae6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 00:39:00.720683 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:00.720303 2521 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" Jun 10 00:39:00.720828 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:00.720798 2521 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bdf0e42bda187111665d728620c4cd0d936632648ed02f395595bc116c849621"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 00:39:00.720870 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:00.720850 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" podUID="53c7267b-54fc-4d76-b37a-ee2832b46ae6" containerName="service-proxy" containerID="cri-o://bdf0e42bda187111665d728620c4cd0d936632648ed02f395595bc116c849621" gracePeriod=30 Jun 10 00:39:01.015597 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:01.015509 2521 generic.go:356] "Generic (PLEG): container finished" podID="53c7267b-54fc-4d76-b37a-ee2832b46ae6" containerID="bdf0e42bda187111665d728620c4cd0d936632648ed02f395595bc116c849621" exitCode=2 Jun 10 00:39:01.015597 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:01.015569 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerDied","Data":"bdf0e42bda187111665d728620c4cd0d936632648ed02f395595bc116c849621"} Jun 10 00:39:01.015597 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:01.015599 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cb8cbbd-rhh58" event={"ID":"53c7267b-54fc-4d76-b37a-ee2832b46ae6","Type":"ContainerStarted","Data":"c1ad892eb322ff3c32a1a4fa8e8cc04bf2f1528d00cc2f375aa60a70b7d49e16"} Jun 10 00:39:07.090379 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:07.089034 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:07.141752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:07.141700 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:09.167814 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:09.167780 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f688df7f6-rs2zz" podUID="af5bc582-5735-4b5b-827a-19addeb03580" containerName="console" containerID="cri-o://51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620" gracePeriod=15 Jun 10 00:39:09.227860 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:09.227827 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:12.108228 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:12.108189 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6475885df6-4x9xw" podUID="3c48a643-051c-4e66-8308-ea10e6b0ee44" containerName="console" containerID="cri-o://5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4" gracePeriod=15 Jun 10 00:39:16.619227 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:16.619188 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:16.725223 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:16.725173 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:24.802953 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.802929 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f688df7f6-rs2zz_af5bc582-5735-4b5b-827a-19addeb03580/console/0.log" Jun 10 00:39:24.805012 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.804997 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:39:24.872060 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872028 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872060 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872065 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872091 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872124 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872155 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872266 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872229 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config\") pod \"af5bc582-5735-4b5b-827a-19addeb03580\" (UID: \"af5bc582-5735-4b5b-827a-19addeb03580\") " Jun 10 00:39:24.872522 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872495 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca" (OuterVolumeSpecName: "service-ca") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:24.872688 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872656 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:24.872778 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.872691 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config" (OuterVolumeSpecName: "console-config") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:24.874391 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.874365 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:39:24.874486 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.874460 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr" (OuterVolumeSpecName: "kube-api-access-9qmtr") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "kube-api-access-9qmtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:39:24.874538 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.874501 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af5bc582-5735-4b5b-827a-19addeb03580" (UID: "af5bc582-5735-4b5b-827a-19addeb03580"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973510 2521 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-console-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973551 2521 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-oauth-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973562 2521 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-service-ca\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973571 2521 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af5bc582-5735-4b5b-827a-19addeb03580-oauth-serving-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973579 2521 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af5bc582-5735-4b5b-827a-19addeb03580-console-serving-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:24.973606 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:24.973587 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/af5bc582-5735-4b5b-827a-19addeb03580-kube-api-access-9qmtr\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:25.106371 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106344 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f688df7f6-rs2zz_af5bc582-5735-4b5b-827a-19addeb03580/console/0.log" Jun 10 00:39:25.106550 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106386 2521 generic.go:356] "Generic (PLEG): container finished" podID="af5bc582-5735-4b5b-827a-19addeb03580" containerID="51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620" exitCode=137 Jun 10 00:39:25.106550 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106458 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f688df7f6-rs2zz" Jun 10 00:39:25.106550 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106481 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f688df7f6-rs2zz" event={"ID":"af5bc582-5735-4b5b-827a-19addeb03580","Type":"ContainerDied","Data":"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620"} Jun 10 00:39:25.106550 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106532 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f688df7f6-rs2zz" event={"ID":"af5bc582-5735-4b5b-827a-19addeb03580","Type":"ContainerDied","Data":"1a7fe452d8b15477ba225e59029e931ccb6e39d58ec167c89803f9cf5c22acb7"} Jun 10 00:39:25.106698 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.106564 2521 scope.go:117] "RemoveContainer" containerID="51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620" Jun 10 00:39:25.115104 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.115090 2521 scope.go:117] "RemoveContainer" containerID="51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620" Jun 10 00:39:25.115370 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:39:25.115350 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620\": container with ID starting with 51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620 not found: ID does not exist" containerID="51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620" Jun 10 00:39:25.115409 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.115380 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620"} err="failed to get container status \"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620\": rpc error: code = NotFound desc = could not find container \"51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620\": container with ID starting with 51e9000a8f4e044adab7c1ee652cad9baadacd34d7b4262f5b9014ac62c74620 not found: ID does not exist" Jun 10 00:39:25.126185 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.126159 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:39:25.129484 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:25.129464 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f688df7f6-rs2zz"] Jun 10 00:39:26.065846 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.065810 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:26.166838 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.166804 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:26.248307 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.248278 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af5bc582-5735-4b5b-827a-19addeb03580" path="/var/lib/kubelet/pods/af5bc582-5735-4b5b-827a-19addeb03580/volumes" Jun 10 00:39:26.696118 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.696091 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:26.746369 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.746335 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:26.798525 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.798497 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:26.854563 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:26.854532 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:27.245747 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.245723 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6475885df6-4x9xw_3c48a643-051c-4e66-8308-ea10e6b0ee44/console/0.log" Jun 10 00:39:27.248049 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.248034 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:39:27.294183 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294150 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294183 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294194 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294415 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294243 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294415 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294293 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkgcq\" (UniqueName: \"kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294415 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294325 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294415 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294364 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294627 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294464 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config\") pod \"3c48a643-051c-4e66-8308-ea10e6b0ee44\" (UID: \"3c48a643-051c-4e66-8308-ea10e6b0ee44\") " Jun 10 00:39:27.294793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294749 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:27.294923 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294788 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca" (OuterVolumeSpecName: "service-ca") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:27.294923 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.294912 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:27.295061 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.295039 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config" (OuterVolumeSpecName: "console-config") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:39:27.296506 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.296484 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:39:27.296941 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.296917 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:39:27.296941 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.296930 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq" (OuterVolumeSpecName: "kube-api-access-lkgcq") pod "3c48a643-051c-4e66-8308-ea10e6b0ee44" (UID: "3c48a643-051c-4e66-8308-ea10e6b0ee44"). InnerVolumeSpecName "kube-api-access-lkgcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395843 2521 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-serving-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395877 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkgcq\" (UniqueName: \"kubernetes.io/projected/3c48a643-051c-4e66-8308-ea10e6b0ee44-kube-api-access-lkgcq\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395890 2521 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-service-ca\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395901 2521 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-oauth-serving-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395914 2521 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395927 2521 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c48a643-051c-4e66-8308-ea10e6b0ee44-trusted-ca-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:27.395942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:27.395938 2521 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c48a643-051c-4e66-8308-ea10e6b0ee44-console-oauth-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:39:28.102967 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.102929 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:39:28.105160 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.105141 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e204723b-797e-42f4-beb4-2dd1f95805c8-metrics-certs\") pod \"network-metrics-daemon-xbhcm\" (UID: \"e204723b-797e-42f4-beb4-2dd1f95805c8\") " pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:39:28.119505 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119482 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6475885df6-4x9xw_3c48a643-051c-4e66-8308-ea10e6b0ee44/console/0.log" Jun 10 00:39:28.119655 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119519 2521 generic.go:356] "Generic (PLEG): container finished" podID="3c48a643-051c-4e66-8308-ea10e6b0ee44" containerID="5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4" exitCode=137 Jun 10 00:39:28.119655 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119572 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475885df6-4x9xw" Jun 10 00:39:28.119655 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119618 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475885df6-4x9xw" event={"ID":"3c48a643-051c-4e66-8308-ea10e6b0ee44","Type":"ContainerDied","Data":"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4"} Jun 10 00:39:28.119823 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119666 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475885df6-4x9xw" event={"ID":"3c48a643-051c-4e66-8308-ea10e6b0ee44","Type":"ContainerDied","Data":"e94b2211dd6475d1d79d39ade34e3a9d1abd24f6641134c8624bc6bc085d4aeb"} Jun 10 00:39:28.119823 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.119685 2521 scope.go:117] "RemoveContainer" containerID="5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4" Jun 10 00:39:28.127333 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.127316 2521 scope.go:117] "RemoveContainer" containerID="5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4" Jun 10 00:39:28.127621 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:39:28.127597 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4\": container with ID starting with 5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4 not found: ID does not exist" containerID="5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4" Jun 10 00:39:28.127709 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.127626 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4"} err="failed to get container status \"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4\": rpc error: code = NotFound desc = could not find container \"5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4\": container with ID starting with 5be718e0cbcbf8cf12d72860b8b3718c6537f5b20e2c2bcf3addc61c6ff012c4 not found: ID does not exist" Jun 10 00:39:28.139763 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.139739 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:39:28.141857 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.141832 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6475885df6-4x9xw"] Jun 10 00:39:28.148398 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.148381 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:39:28.156861 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.156847 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xbhcm" Jun 10 00:39:28.248938 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.248906 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c48a643-051c-4e66-8308-ea10e6b0ee44" path="/var/lib/kubelet/pods/3c48a643-051c-4e66-8308-ea10e6b0ee44/volumes" Jun 10 00:39:28.279377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:28.279357 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xbhcm"] Jun 10 00:39:28.281679 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:39:28.281645 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode204723b_797e_42f4_beb4_2dd1f95805c8.slice/crio-0da917f5d590286739b80803ced2d9de726b890bc264868068a603394f40c2d9 WatchSource:0}: Error finding container 0da917f5d590286739b80803ced2d9de726b890bc264868068a603394f40c2d9: Status 404 returned error can't find the container with id 0da917f5d590286739b80803ced2d9de726b890bc264868068a603394f40c2d9 Jun 10 00:39:29.126793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:29.126752 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcm" event={"ID":"e204723b-797e-42f4-beb4-2dd1f95805c8","Type":"ContainerStarted","Data":"0da917f5d590286739b80803ced2d9de726b890bc264868068a603394f40c2d9"} Jun 10 00:39:30.131285 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.131252 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcm" event={"ID":"e204723b-797e-42f4-beb4-2dd1f95805c8","Type":"ContainerStarted","Data":"dbb6aee2f84e97808c5673276f233511289edb2ced0d663185893a9a59e5b440"} Jun 10 00:39:30.131723 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.131314 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xbhcm" event={"ID":"e204723b-797e-42f4-beb4-2dd1f95805c8","Type":"ContainerStarted","Data":"cc0b71c17e0116ed49d028d4160693d67c45b8807ea7af75e8b84672e92d6c39"} Jun 10 00:39:30.147412 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.147359 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xbhcm" podStartSLOduration=253.323735501 podStartE2EDuration="4m14.147343684s" totalImagesPullingTime="823.608183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:39:30.145460467 +0000 UTC m=+254.390919547" watchObservedRunningTime="2026-06-10 00:39:30.147343684 +0000 UTC m=+254.392802763" Jun 10 00:39:30.218556 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.218526 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:30.268978 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.268945 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:30.316192 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:30.316157 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:35.728457 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:35.728401 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:35.777207 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:35.777171 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:40.226344 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:40.226316 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/init-textfile/0.log" Jun 10 00:39:40.330696 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:40.330659 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:40.427205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:40.427173 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/node-exporter/0.log" Jun 10 00:39:40.430677 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:40.430656 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:40.626085 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:40.626058 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/kube-rbac-proxy/0.log" Jun 10 00:39:41.428240 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:41.428207 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/init-config-reloader/0.log" Jun 10 00:39:41.628327 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:41.628290 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/prometheus/0.log" Jun 10 00:39:41.826612 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:41.826583 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/config-reloader/0.log" Jun 10 00:39:42.026825 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:42.026796 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/thanos-sidecar/0.log" Jun 10 00:39:42.226788 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:42.226704 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/kube-rbac-proxy-web/0.log" Jun 10 00:39:42.427788 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:42.427758 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/kube-rbac-proxy/0.log" Jun 10 00:39:42.627486 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:42.627460 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6fa32913-ae91-4933-a185-41d0aa28f52a/kube-rbac-proxy-thanos/0.log" Jun 10 00:39:43.426614 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:43.426583 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/telemeter-client/0.log" Jun 10 00:39:43.626715 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:43.626688 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/reload/0.log" Jun 10 00:39:43.826885 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:43.826856 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/kube-rbac-proxy/0.log" Jun 10 00:39:44.757962 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:44.757909 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:39:44.777918 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:44.777894 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:39:45.200780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:45.200752 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:39:45.206307 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:45.206275 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:47.828832 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:47.828800 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ck45j_039c063d-1d7c-467b-8ef5-9e468078a18c/dns-node-resolver/0.log" Jun 10 00:39:49.027649 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:49.027611 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9zpt_b569054a-1cb2-46cb-bcc6-99f6ff515e79/node-ca/0.log" Jun 10 00:39:50.026845 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:50.026823 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkzjd_aa75d238-2f3d-43b8-9787-7c2b884152a0/serve-healthcheck-canary/0.log" Jun 10 00:39:54.334318 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:54.334284 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:54.434516 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:54.434482 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:54.892921 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:54.892887 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:39:55.762709 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:39:55.762650 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cv84d" podUID="c7c279e6-c0d0-468b-9940-45b25b385669" Jun 10 00:39:56.221899 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:56.221875 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cv84d" Jun 10 00:39:58.230701 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:58.230614 2521 generic.go:356] "Generic (PLEG): container finished" podID="b0339e47-250e-4e50-bcdc-348c35fb67ca" containerID="9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d" exitCode=1 Jun 10 00:39:58.230701 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:58.230657 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerDied","Data":"9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d"} Jun 10 00:39:58.231122 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:58.230702 2521 scope.go:117] "RemoveContainer" containerID="e8c86b79b636353db542d347f7d01fd31b0b61d49648fa415f3eed45fe46d9ab" Jun 10 00:39:58.231122 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:58.230992 2521 scope.go:117] "RemoveContainer" containerID="9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d" Jun 10 00:39:58.231201 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:39:58.231182 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b69f479fc-d7pn6_open-cluster-management-agent-addon(b0339e47-250e-4e50-bcdc-348c35fb67ca)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" podUID="b0339e47-250e-4e50-bcdc-348c35fb67ca" Jun 10 00:39:58.783000 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:58.782955 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:39:59.235680 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.235655 2521 scope.go:117] "RemoveContainer" containerID="9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d" Jun 10 00:39:59.236045 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:39:59.235831 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b69f479fc-d7pn6_open-cluster-management-agent-addon(b0339e47-250e-4e50-bcdc-348c35fb67ca)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" podUID="b0339e47-250e-4e50-bcdc-348c35fb67ca" Jun 10 00:39:59.575205 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.575161 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:39:59.577682 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.577645 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7c279e6-c0d0-468b-9940-45b25b385669-metrics-tls\") pod \"dns-default-cv84d\" (UID: \"c7c279e6-c0d0-468b-9940-45b25b385669\") " pod="openshift-dns/dns-default-cv84d" Jun 10 00:39:59.824889 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.824862 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:39:59.833369 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.833306 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cv84d" Jun 10 00:39:59.957621 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:39:59.957585 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cv84d"] Jun 10 00:39:59.959878 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:39:59.959854 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c279e6_c0d0_468b_9940_45b25b385669.slice/crio-df896d1251a5cb3400a8904044fee17471b63dd405db7454f2a3400e6d4249c7 WatchSource:0}: Error finding container df896d1251a5cb3400a8904044fee17471b63dd405db7454f2a3400e6d4249c7: Status 404 returned error can't find the container with id df896d1251a5cb3400a8904044fee17471b63dd405db7454f2a3400e6d4249c7 Jun 10 00:40:00.239665 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:00.239575 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cv84d" event={"ID":"c7c279e6-c0d0-468b-9940-45b25b385669","Type":"ContainerStarted","Data":"df896d1251a5cb3400a8904044fee17471b63dd405db7454f2a3400e6d4249c7"} Jun 10 00:40:00.695598 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:00.695561 2521 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:40:00.696010 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:00.695992 2521 scope.go:117] "RemoveContainer" containerID="9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d" Jun 10 00:40:00.696213 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:00.696190 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b69f479fc-d7pn6_open-cluster-management-agent-addon(b0339e47-250e-4e50-bcdc-348c35fb67ca)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" podUID="b0339e47-250e-4e50-bcdc-348c35fb67ca" Jun 10 00:40:02.248962 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.248930 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cv84d" event={"ID":"c7c279e6-c0d0-468b-9940-45b25b385669","Type":"ContainerStarted","Data":"38129751e86e808f953d6c3d73770cd71123fe7e4efde095097cfa91eaa91d8f"} Jun 10 00:40:02.249322 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.248978 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cv84d" event={"ID":"c7c279e6-c0d0-468b-9940-45b25b385669","Type":"ContainerStarted","Data":"3395919930fbee47f7ee0ba3166f50b0c603cf3091e620b034ca24b2b71dcb59"} Jun 10 00:40:02.249322 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.249061 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cv84d" Jun 10 00:40:02.266511 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.266459 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cv84d" podStartSLOduration=251.871154168 podStartE2EDuration="4m13.266429856s" totalImagesPullingTime="1.395275688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:40:02.266046011 +0000 UTC m=+286.511505091" watchObservedRunningTime="2026-06-10 00:40:02.266429856 +0000 UTC m=+286.511888936" Jun 10 00:40:02.790123 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790072 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:02.790514 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790452 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="prometheus" containerID="cri-o://a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" gracePeriod=600 Jun 10 00:40:02.790514 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790479 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-web" containerID="cri-o://f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" gracePeriod=600 Jun 10 00:40:02.790662 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790607 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="thanos-sidecar" containerID="cri-o://685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" gracePeriod=600 Jun 10 00:40:02.790662 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790648 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy" containerID="cri-o://1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" gracePeriod=600 Jun 10 00:40:02.790773 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790667 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="config-reloader" containerID="cri-o://21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" gracePeriod=600 Jun 10 00:40:02.790829 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:02.790812 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" gracePeriod=600 Jun 10 00:40:03.036550 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.036526 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.102131 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102092 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102131 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102131 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102384 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102159 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102384 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102186 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102384 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102221 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102627 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102593 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102657 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102696 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102742 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102771 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102795 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102823 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102852 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102882 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102912 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102938 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.102979 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102966 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.103370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.102994 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.103370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.103033 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.103370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.103064 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xbqn\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn\") pod \"6fa32913-ae91-4933-a185-41d0aa28f52a\" (UID: \"6fa32913-ae91-4933-a185-41d0aa28f52a\") " Jun 10 00:40:03.103370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.103229 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.103370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.103328 2521 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.104352 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.104320 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.104487 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.104392 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.104559 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.104485 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.104729 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.104704 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.104851 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.104832 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.105276 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.105248 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:03.105367 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.105347 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:40:03.106064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.106033 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.106162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.106126 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.106405 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.106362 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:03.106543 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.106511 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn" (OuterVolumeSpecName: "kube-api-access-6xbqn") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "kube-api-access-6xbqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:03.106881 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.106846 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config" (OuterVolumeSpecName: "config") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.107277 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.107238 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.107377 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.107315 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out" (OuterVolumeSpecName: "config-out") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:40:03.108384 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.108331 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.108384 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.108349 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.108569 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.108408 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.108887 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.108861 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.117360 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.117333 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config" (OuterVolumeSpecName: "web-config") pod "6fa32913-ae91-4933-a185-41d0aa28f52a" (UID: "6fa32913-ae91-4933-a185-41d0aa28f52a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:03.204417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204378 2521 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-tls-assets\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204407 2521 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-config-out\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204417 2521 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204427 2521 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-metrics-client-certs\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204456 2521 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204467 2521 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204476 2521 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204485 2521 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-grpc-tls\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204492 2521 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-kube-rbac-proxy\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204500 2521 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204508 2521 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204517 2521 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204527 2521 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204535 2521 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fa32913-ae91-4933-a185-41d0aa28f52a-web-config\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204543 2521 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-configmap-metrics-client-ca\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204551 2521 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-db\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204561 2521 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204569 2521 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fa32913-ae91-4933-a185-41d0aa28f52a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.204697 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.204578 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xbqn\" (UniqueName: \"kubernetes.io/projected/6fa32913-ae91-4933-a185-41d0aa28f52a-kube-api-access-6xbqn\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:40:03.256002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.255972 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" exitCode=0 Jun 10 00:40:03.256002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.255996 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" exitCode=0 Jun 10 00:40:03.256002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256004 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" exitCode=0 Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256010 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" exitCode=0 Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256018 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" exitCode=0 Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256024 2521 generic.go:356] "Generic (PLEG): container finished" podID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" exitCode=0 Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256045 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256061 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256134 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256164 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256195 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256207 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256233 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256273 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} Jun 10 00:40:03.256492 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.256309 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fa32913-ae91-4933-a185-41d0aa28f52a","Type":"ContainerDied","Data":"dacf9ec7ebb422a10ad67988173294d1e9aa50e9c6a994e30783ab5ac184fa79"} Jun 10 00:40:03.264943 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.264778 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.272182 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.272167 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.278831 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.278811 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.282087 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.282067 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:03.285944 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.285929 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.287006 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.286986 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:03.292612 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.292576 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.299512 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.299492 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.305982 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.305966 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.306239 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.306221 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.306302 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306252 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.306302 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306277 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.306568 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.306550 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.306620 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306574 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.306620 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306590 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.306827 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.306810 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.306863 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306832 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.306863 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.306847 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.307069 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.307053 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.307130 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307078 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.307130 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307099 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.307329 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.307315 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.307367 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307334 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.307367 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307347 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.307613 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.307596 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.307686 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307620 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.307686 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307639 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.307854 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:40:03.307836 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.307914 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307861 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.307914 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.307879 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.308097 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308080 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.308162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308098 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.308316 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308298 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.308368 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308327 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.308582 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308565 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.308649 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308583 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.308825 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308806 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.308892 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.308827 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.309050 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309035 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.309114 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309051 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.309264 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309246 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.309313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309265 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.309528 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309509 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.309614 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309528 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.309782 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309765 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.309782 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.309782 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.310048 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310023 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.310124 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310050 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.310345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310324 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.310390 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310347 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.310610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310594 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.310663 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310611 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.310818 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310803 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.310861 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310819 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.311004 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.310989 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.311048 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311004 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.311195 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311175 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.311195 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311192 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.311428 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311402 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.311504 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311450 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.311504 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311416 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:03.311738 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311713 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.311738 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311729 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-web" Jun 10 00:40:03.311738 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311738 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311743 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-web" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311757 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="prometheus" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311765 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="prometheus" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311781 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="init-config-reloader" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311789 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="init-config-reloader" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311803 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af5bc582-5735-4b5b-827a-19addeb03580" containerName="console" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311811 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="af5bc582-5735-4b5b-827a-19addeb03580" containerName="console" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311822 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-thanos" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311828 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-thanos" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311837 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c48a643-051c-4e66-8308-ea10e6b0ee44" containerName="console" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311844 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c48a643-051c-4e66-8308-ea10e6b0ee44" containerName="console" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311853 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311861 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311871 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="config-reloader" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311880 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="config-reloader" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311890 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="thanos-sidecar" Jun 10 00:40:03.311934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311899 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="thanos-sidecar" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311951 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c48a643-051c-4e66-8308-ea10e6b0ee44" containerName="console" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311960 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="prometheus" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311971 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="af5bc582-5735-4b5b-827a-19addeb03580" containerName="console" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311969 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311989 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.311976 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="config-reloader" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312052 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="thanos-sidecar" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312062 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-web" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312073 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312083 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" containerName="kube-rbac-proxy-thanos" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312261 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312278 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312543 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.312600 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312561 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.313064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312804 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.313064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.312818 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.313064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313053 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.313161 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313069 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.313305 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313286 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.313374 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313306 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.313554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313539 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.313614 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313554 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.313769 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313751 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.313812 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313769 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.313986 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313970 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.313986 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.313985 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.314204 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314185 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.314244 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314206 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.314466 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314447 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.314512 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314467 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.314681 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314666 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.314731 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314682 2521 scope.go:117] "RemoveContainer" containerID="860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06" Jun 10 00:40:03.314903 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314886 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06"} err="failed to get container status \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": rpc error: code = NotFound desc = could not find container \"860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06\": container with ID starting with 860fc09e52244384b71d058492bc897d481187400d4054b11c81c4c97195bf06 not found: ID does not exist" Jun 10 00:40:03.314903 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.314902 2521 scope.go:117] "RemoveContainer" containerID="1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7" Jun 10 00:40:03.315074 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315060 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7"} err="failed to get container status \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": rpc error: code = NotFound desc = could not find container \"1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7\": container with ID starting with 1fc0994ab2dfe7ed901e81d6a1a5629b3b6cc9ec3f521867e0b8d324233a6cf7 not found: ID does not exist" Jun 10 00:40:03.315074 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315074 2521 scope.go:117] "RemoveContainer" containerID="f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f" Jun 10 00:40:03.315299 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315279 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f"} err="failed to get container status \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": rpc error: code = NotFound desc = could not find container \"f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f\": container with ID starting with f641177c79fc5ef21316ef1e998e79d2a67e1e5475670140a028e85d06d0a20f not found: ID does not exist" Jun 10 00:40:03.315348 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315300 2521 scope.go:117] "RemoveContainer" containerID="685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d" Jun 10 00:40:03.315560 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315542 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d"} err="failed to get container status \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": rpc error: code = NotFound desc = could not find container \"685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d\": container with ID starting with 685050ec431ec02ea178a1020ef896c8cc73afee9032cd1a31e6fcc31e98622d not found: ID does not exist" Jun 10 00:40:03.315610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315560 2521 scope.go:117] "RemoveContainer" containerID="21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989" Jun 10 00:40:03.315780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315764 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989"} err="failed to get container status \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": rpc error: code = NotFound desc = could not find container \"21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989\": container with ID starting with 21a18248b51487193b6c29c6bddaa4de47d30cce99d96034ddeaf2d31361d989 not found: ID does not exist" Jun 10 00:40:03.315824 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315780 2521 scope.go:117] "RemoveContainer" containerID="a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65" Jun 10 00:40:03.315956 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315941 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65"} err="failed to get container status \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": rpc error: code = NotFound desc = could not find container \"a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65\": container with ID starting with a289f720999457a407660aa800e260c87512a4aa0b2c1c7e39bc6a7549be3b65 not found: ID does not exist" Jun 10 00:40:03.315992 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.315955 2521 scope.go:117] "RemoveContainer" containerID="a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a" Jun 10 00:40:03.316153 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.316133 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a"} err="failed to get container status \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": rpc error: code = NotFound desc = could not find container \"a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a\": container with ID starting with a22d4a7e9c072c2410e13fa5f50586be85a00b3920a0026f3c5ab21d0be8056a not found: ID does not exist" Jun 10 00:40:03.317312 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.317298 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.320210 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320191 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 00:40:03.320305 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320198 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 00:40:03.320305 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320296 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 00:40:03.320413 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320309 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 00:40:03.320566 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320553 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 00:40:03.320642 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320627 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66jfd\"" Jun 10 00:40:03.320758 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320741 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 00:40:03.320951 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320928 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 00:40:03.321034 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320947 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 00:40:03.321034 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320964 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 00:40:03.321034 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320990 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 00:40:03.321175 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.320948 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 00:40:03.321175 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.321047 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 00:40:03.321175 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.321076 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9dakcchavt7ma\"" Jun 10 00:40:03.321327 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.321311 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 00:40:03.324233 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.324203 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 00:40:03.326693 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.326672 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 00:40:03.340969 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.340937 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:03.406519 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406397 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406519 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406460 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406519 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406480 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406554 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406624 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406663 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406680 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406695 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406713 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.406765 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406738 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406800 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406815 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406832 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406846 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406881 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406897 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjqw\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-kube-api-access-svjqw\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406913 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406931 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406948 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.407075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.406987 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508275 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508313 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508337 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508357 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508414 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508475 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508498 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508525 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508551 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508598 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508623 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508649 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508675 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508704 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508729 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjqw\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-kube-api-access-svjqw\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508744 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508757 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508803 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508837 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508874 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.508916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.508912 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.509545 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.509105 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.509545 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.509199 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.509702 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.509557 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.509763 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.509748 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.511514 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.511201 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.511514 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.511379 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.511784 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.511759 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.511882 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.511855 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.511942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.511889 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.512213 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.512187 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.512299 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.512244 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.512654 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.512626 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.512808 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.512791 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.512995 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.512972 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.513788 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.513767 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.514099 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.514083 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.514709 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.514692 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.515096 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.515080 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.519898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.519878 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjqw\" (UniqueName: \"kubernetes.io/projected/1e8972d2-b3dc-4853-8aca-83c0f8eb196b-kube-api-access-svjqw\") pod \"prometheus-k8s-0\" (UID: \"1e8972d2-b3dc-4853-8aca-83c0f8eb196b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.628305 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.628262 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:03.760454 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:03.760266 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 00:40:03.762873 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:40:03.762844 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8972d2_b3dc_4853_8aca_83c0f8eb196b.slice/crio-febd499aec328d06d6278a4b6727b8bc9f6007f061347cbd3e5393bdb627d936 WatchSource:0}: Error finding container febd499aec328d06d6278a4b6727b8bc9f6007f061347cbd3e5393bdb627d936: Status 404 returned error can't find the container with id febd499aec328d06d6278a4b6727b8bc9f6007f061347cbd3e5393bdb627d936 Jun 10 00:40:04.248227 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.248192 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa32913-ae91-4933-a185-41d0aa28f52a" path="/var/lib/kubelet/pods/6fa32913-ae91-4933-a185-41d0aa28f52a/volumes" Jun 10 00:40:04.261628 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.261598 2521 generic.go:356] "Generic (PLEG): container finished" podID="1e8972d2-b3dc-4853-8aca-83c0f8eb196b" containerID="557d4242488e8cbb115994be7af13a515ab6b090083ecb4349d569f8a9eaccac" exitCode=0 Jun 10 00:40:04.261948 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.261649 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerDied","Data":"557d4242488e8cbb115994be7af13a515ab6b090083ecb4349d569f8a9eaccac"} Jun 10 00:40:04.261948 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.261697 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"febd499aec328d06d6278a4b6727b8bc9f6007f061347cbd3e5393bdb627d936"} Jun 10 00:40:04.372662 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.372636 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:04.475458 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:04.474849 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:05.268640 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268606 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"39c8fe3a18be1e1a88446a2363374b7eb9ae577b90e5988ca0990328f55078e8"} Jun 10 00:40:05.269052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268666 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"4e41830ad02f351d8e9c0c7295dcabfe8848700b419bcc5e1d6b4ffefef43ad3"} Jun 10 00:40:05.269052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268693 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"e983287e1fe726fcc80589ad8bf220f50a89056ac9204f251edd95e21753caa7"} Jun 10 00:40:05.269052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268717 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"b9718b51c8a044f479dfff99eadedc7ef7716dabade23fd8ac467f254afeca13"} Jun 10 00:40:05.269052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268744 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"71734ec899d03f7f98f4d3334f1ff033fd2bd24ca14f1f25301a1223d0e67c2f"} Jun 10 00:40:05.269052 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.268766 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8972d2-b3dc-4853-8aca-83c0f8eb196b","Type":"ContainerStarted","Data":"b29519f5cd7dffc2bbb60940c9d99eee1579c33b350721e967d8bb6a589a228b"} Jun 10 00:40:05.297504 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.297424 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.280032247 podStartE2EDuration="2.297401963s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.369716ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:40:05.294988547 +0000 UTC m=+289.540447665" watchObservedRunningTime="2026-06-10 00:40:05.297401963 +0000 UTC m=+289.542861043" Jun 10 00:40:05.982217 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:05.982182 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:06.082828 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:06.082774 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:08.628490 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:08.628459 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:40:11.244209 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:11.244174 2521 scope.go:117] "RemoveContainer" containerID="9fef71e58da8ead7b1dbafd8b4dc723f7b11b9e425566fbf7999dc28ce951e6d" Jun 10 00:40:11.790989 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:11.790955 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:11.891108 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:11.891063 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:12.259460 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:12.259416 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cv84d" Jun 10 00:40:12.294580 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:12.294548 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" event={"ID":"b0339e47-250e-4e50-bcdc-348c35fb67ca","Type":"ContainerStarted","Data":"a4731dbda3d82a5796a7382b2d3442fc84f85c9a5920776e1b6b80a0b31aeaf3"} Jun 10 00:40:12.294815 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:12.294773 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:40:12.296085 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:12.296068 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b69f479fc-d7pn6" Jun 10 00:40:13.878532 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:13.878492 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:13.928933 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:13.928898 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:16.191061 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:16.191032 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:40:16.194193 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:16.194171 2521 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 00:40:16.196877 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:16.196854 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:40:17.569009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:17.568974 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:17.820122 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:17.820028 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:17.864940 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:17.864907 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:18.276663 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:18.276569 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:18.321522 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:18.321492 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:19.862742 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:19.862707 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:19.910455 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:19.910408 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:19.996179 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:19.996147 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:20.044662 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:20.044630 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:22.811747 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:22.811702 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:22.913780 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:22.913750 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:23.517714 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:23.517673 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:23.618565 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:23.618530 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:25.466383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:25.466339 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:25.519853 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:25.519789 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:25.575921 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:25.575887 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:26.921449 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:26.921409 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:26.969608 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:26.969578 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:29.633723 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:29.633687 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:29.689623 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:29.689592 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:37.884299 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:37.884261 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:37.933166 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:37.933134 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:41.789820 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:41.789781 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:41.839811 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:41.839773 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:50.770682 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:50.770632 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:50.870057 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:50.870022 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:57.965108 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:57.965069 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:58.066699 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:58.066660 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:40:58.112481 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:40:58.112452 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:41:03.629263 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:41:03.629166 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:41:03.644627 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:41:03.644593 2521 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:41:04.400752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:41:04.400715 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:41:04.446996 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:41:04.446967 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:41:04.483431 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:41:04.483407 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 00:42:18.145175 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:42:18.145137 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:43:58.034168 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:43:58.034138 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:43:59.159103 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:43:59.159070 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:00.672176 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:00.672094 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:08.487136 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:08.487102 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:08.531748 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:08.531719 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:08.587297 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:08.587269 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:08.635634 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:08.635609 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:42.733630 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:42.733595 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:42.834139 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:42.834099 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:44.780989 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:44.780951 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:44.833154 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:44.833116 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:56.796761 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:56.796727 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:56.896029 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:56.895992 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:44:56.944064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:44:56.944036 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:45:16.218231 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:45:16.218205 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:45:16.221760 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:45:16.221737 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:45:41.885413 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:45:41.885360 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:45:41.984426 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:45:41.984393 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:04.950802 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:04.950769 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:05.006413 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:05.006384 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:08.129358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:08.129326 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:09.466284 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:09.466251 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:11.736624 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:11.736580 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:11.781553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:11.781526 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:12.316750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:12.316716 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:12.407618 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:12.407585 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:12.666212 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:12.666138 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:12.766130 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:12.766099 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:16.110742 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:16.110711 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:16.500773 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:16.500700 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:18.940006 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:18.939971 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:18.987095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:18.987068 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:21.986838 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:21.986805 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:22.034633 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:22.034604 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:22.350194 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:22.350161 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:22.448305 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:22.448269 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:23.709166 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:23.709134 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:27.696043 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:27.696010 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:27.796656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:27.796623 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:29.915268 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:29.915229 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:44.953705 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:44.953670 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:45.048566 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.048532 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:45.596930 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.596898 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:45.850136 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.850049 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:45.948113 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.948068 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:45.980826 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.980794 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r"] Jun 10 00:46:45.983910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.983889 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:45.986798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.986765 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 00:46:45.986798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.986777 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ckhbh\"" Jun 10 00:46:45.986798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.986781 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 00:46:45.986798 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.986798 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 00:46:45.987050 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.986820 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 00:46:45.996357 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:45.996337 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r"] Jun 10 00:46:46.065734 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.065698 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szpnk\" (UniqueName: \"kubernetes.io/projected/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-kube-api-access-szpnk\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.065734 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.065746 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.065960 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.065768 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.065960 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.065816 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.065960 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.065836 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.085916 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.085884 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:46.166303 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166215 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.166303 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166252 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.166303 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166299 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szpnk\" (UniqueName: \"kubernetes.io/projected/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-kube-api-access-szpnk\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.166609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166328 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.166609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166357 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.166889 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.166861 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.168769 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.168743 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.168900 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.168882 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.168966 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.168948 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.176794 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.176770 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szpnk\" (UniqueName: \"kubernetes.io/projected/3923f78f-074b-4802-bf4d-d54f2cb0c3c3-kube-api-access-szpnk\") pod \"opendatahub-operator-controller-manager-7746866678-j8k6r\" (UID: \"3923f78f-074b-4802-bf4d-d54f2cb0c3c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.186048 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.186012 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:46.286636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.286605 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:46.293639 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.293615 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:46.387557 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.387514 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:46.430405 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.430314 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r"] Jun 10 00:46:46.432739 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:46:46.432713 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3923f78f_074b_4802_bf4d_d54f2cb0c3c3.slice/crio-18b541f1a9bfa4354da6d802a377dd22121f41c958f5d28a8064946c5c800d07 WatchSource:0}: Error finding container 18b541f1a9bfa4354da6d802a377dd22121f41c958f5d28a8064946c5c800d07: Status 404 returned error can't find the container with id 18b541f1a9bfa4354da6d802a377dd22121f41c958f5d28a8064946c5c800d07 Jun 10 00:46:46.434578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.434547 2521 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:46:46.454972 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.454942 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:46.625093 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:46.625058 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" event={"ID":"3923f78f-074b-4802-bf4d-d54f2cb0c3c3","Type":"ContainerStarted","Data":"18b541f1a9bfa4354da6d802a377dd22121f41c958f5d28a8064946c5c800d07"} Jun 10 00:46:49.637554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:49.637520 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" event={"ID":"3923f78f-074b-4802-bf4d-d54f2cb0c3c3","Type":"ContainerStarted","Data":"a197b0e5dbab4dae2eb6a6fac4810eaa182533676946ac997def4c929655cb7e"} Jun 10 00:46:50.642607 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:50.642574 2521 generic.go:356] "Generic (PLEG): container finished" podID="3923f78f-074b-4802-bf4d-d54f2cb0c3c3" containerID="a197b0e5dbab4dae2eb6a6fac4810eaa182533676946ac997def4c929655cb7e" exitCode=0 Jun 10 00:46:50.643089 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:50.642631 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" event={"ID":"3923f78f-074b-4802-bf4d-d54f2cb0c3c3","Type":"ContainerDied","Data":"a197b0e5dbab4dae2eb6a6fac4810eaa182533676946ac997def4c929655cb7e"} Jun 10 00:46:51.648320 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:51.648276 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" event={"ID":"3923f78f-074b-4802-bf4d-d54f2cb0c3c3","Type":"ContainerStarted","Data":"c545397a23e7b2efe23bb7d59bb71f810fa4e55bcb25d5294c7ad946dae75c1c"} Jun 10 00:46:51.648740 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:51.648417 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:46:51.670563 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:51.670512 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" podStartSLOduration=2.388426167 podStartE2EDuration="6.670493415s" totalImagesPullingTime="3.288093931s" totalInitContainerRuntime="993.973317ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:51.669899714 +0000 UTC m=+695.915358794" watchObservedRunningTime="2026-06-10 00:46:51.670493415 +0000 UTC m=+695.915952494" Jun 10 00:46:59.406291 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:59.406260 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:46:59.505986 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:46:59.505956 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:02.654633 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:02.654558 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-j8k6r" Jun 10 00:47:03.383957 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.383922 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np"] Jun 10 00:47:03.387009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.386989 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.390069 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.390025 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 00:47:03.390167 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.390080 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b4jz6\"" Jun 10 00:47:03.391776 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.391757 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 00:47:03.391948 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.391775 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 00:47:03.391948 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.391784 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:47:03.391948 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.391842 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 00:47:03.394975 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.394938 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np"] Jun 10 00:47:03.523171 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.523133 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fafc349f-f284-427f-b634-85baec288253-manager-config\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.523336 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.523185 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.523336 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.523245 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jr8\" (UniqueName: \"kubernetes.io/projected/fafc349f-f284-427f-b634-85baec288253-kube-api-access-w5jr8\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.523405 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.523347 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.624637 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.624600 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.624637 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.624642 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fafc349f-f284-427f-b634-85baec288253-manager-config\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.624895 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.624766 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.624895 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.624803 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jr8\" (UniqueName: \"kubernetes.io/projected/fafc349f-f284-427f-b634-85baec288253-kube-api-access-w5jr8\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.625334 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.625313 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fafc349f-f284-427f-b634-85baec288253-manager-config\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.627154 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.627132 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.627327 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.627304 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fafc349f-f284-427f-b634-85baec288253-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.636671 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.636610 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jr8\" (UniqueName: \"kubernetes.io/projected/fafc349f-f284-427f-b634-85baec288253-kube-api-access-w5jr8\") pod \"lws-controller-manager-cc5ccc596-gx9np\" (UID: \"fafc349f-f284-427f-b634-85baec288253\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.696789 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.696757 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:03.820104 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:03.820076 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np"] Jun 10 00:47:03.822698 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:47:03.822653 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafc349f_f284_427f_b634_85baec288253.slice/crio-f9b6de60daacd7651472e76d2b56d5267e151dad20c0713b14928c7350068872 WatchSource:0}: Error finding container f9b6de60daacd7651472e76d2b56d5267e151dad20c0713b14928c7350068872: Status 404 returned error can't find the container with id f9b6de60daacd7651472e76d2b56d5267e151dad20c0713b14928c7350068872 Jun 10 00:47:04.697129 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:04.697057 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" event={"ID":"fafc349f-f284-427f-b634-85baec288253","Type":"ContainerStarted","Data":"f9b6de60daacd7651472e76d2b56d5267e151dad20c0713b14928c7350068872"} Jun 10 00:47:05.030345 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.030210 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.137996 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.137960 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.571411 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.571371 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.682075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.682046 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.770915 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.770873 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.849851 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.849772 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.910565 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.910521 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:05.961370 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.961289 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c"] Jun 10 00:47:05.977653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.974152 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:05.977653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.977016 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c"] Jun 10 00:47:05.977653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.977173 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 00:47:05.977653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.977174 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 00:47:05.978598 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.978557 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 00:47:05.978851 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.978830 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 00:47:05.979049 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:05.979027 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzhbc\"" Jun 10 00:47:06.008312 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.008280 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.070724 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.070691 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.150074 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.149980 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051aaa2a-aafc-45f4-8338-d504dd128cad-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.150074 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.150042 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kdf8\" (UniqueName: \"kubernetes.io/projected/051aaa2a-aafc-45f4-8338-d504dd128cad-kube-api-access-6kdf8\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.150308 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.150152 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/051aaa2a-aafc-45f4-8338-d504dd128cad-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.171497 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.171461 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.250991 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.250955 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/051aaa2a-aafc-45f4-8338-d504dd128cad-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.251180 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.251032 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051aaa2a-aafc-45f4-8338-d504dd128cad-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.251180 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.251082 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kdf8\" (UniqueName: \"kubernetes.io/projected/051aaa2a-aafc-45f4-8338-d504dd128cad-kube-api-access-6kdf8\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.253956 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.253924 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051aaa2a-aafc-45f4-8338-d504dd128cad-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.254093 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.254060 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/051aaa2a-aafc-45f4-8338-d504dd128cad-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.259277 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.259246 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kdf8\" (UniqueName: \"kubernetes.io/projected/051aaa2a-aafc-45f4-8338-d504dd128cad-kube-api-access-6kdf8\") pod \"kube-auth-proxy-5bfbfc59b5-4gt7c\" (UID: \"051aaa2a-aafc-45f4-8338-d504dd128cad\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.271297 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.271262 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.291100 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.291063 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" Jun 10 00:47:06.455231 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.455199 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.578698 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.578655 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c"] Jun 10 00:47:06.581196 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:47:06.581164 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051aaa2a_aafc_45f4_8338_d504dd128cad.slice/crio-eebf3a9b7f7dbd505c17ca6af0160ab373f20f85a67f834028f92664d224339b WatchSource:0}: Error finding container eebf3a9b7f7dbd505c17ca6af0160ab373f20f85a67f834028f92664d224339b: Status 404 returned error can't find the container with id eebf3a9b7f7dbd505c17ca6af0160ab373f20f85a67f834028f92664d224339b Jun 10 00:47:06.583906 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.583869 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:06.706621 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.706531 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" event={"ID":"fafc349f-f284-427f-b634-85baec288253","Type":"ContainerStarted","Data":"8069011d6c66c0476014263c68cbe891677d3353e8d62b4387591fa8e609a8ab"} Jun 10 00:47:06.706796 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.706656 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:06.707598 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.707574 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" event={"ID":"051aaa2a-aafc-45f4-8338-d504dd128cad","Type":"ContainerStarted","Data":"eebf3a9b7f7dbd505c17ca6af0160ab373f20f85a67f834028f92664d224339b"} Jun 10 00:47:06.725275 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:06.725232 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" podStartSLOduration=1.044928177 podStartE2EDuration="3.725218817s" totalImagesPullingTime="2.68029064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:06.724397664 +0000 UTC m=+710.969856751" watchObservedRunningTime="2026-06-10 00:47:06.725218817 +0000 UTC m=+710.970677896" Jun 10 00:47:10.729794 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:10.729752 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" event={"ID":"051aaa2a-aafc-45f4-8338-d504dd128cad","Type":"ContainerStarted","Data":"8ff56b6c678bdb568efd1adbdb94358a455cc36f77afca52ec2b30edd108a490"} Jun 10 00:47:10.746755 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:10.746697 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-4gt7c" podStartSLOduration=2.3815960609999998 podStartE2EDuration="5.746681597s" totalImagesPullingTime="3.365085536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:10.745304088 +0000 UTC m=+714.990763179" watchObservedRunningTime="2026-06-10 00:47:10.746681597 +0000 UTC m=+714.992140676" Jun 10 00:47:15.522210 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:15.522174 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:15.602754 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:15.602726 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:15.730090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:15.730057 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:15.822241 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:15.822213 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:16.763316 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:16.763283 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:16.858567 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:16.858539 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:16.960368 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:16.960334 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:17.092139 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:17.092110 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:17.713327 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:17.713296 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-gx9np" Jun 10 00:47:18.277902 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:18.277875 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:18.377056 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:18.376970 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:18.603980 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:18.603920 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:18.826602 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:18.826575 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:19.286406 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:19.286327 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:22.216553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:22.216524 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:28.989125 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:28.989078 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:29.128313 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:29.128261 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:29.493324 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:29.493272 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:29.594187 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:29.594149 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:29.693936 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:29.693906 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:34.637519 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:34.637485 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:34.739828 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:34.739780 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:34.904163 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:34.904084 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:35.099558 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:35.099521 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:35.340230 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:35.340203 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:35.832852 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:35.832815 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:47:59.651854 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:47:59.651819 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:06.440041 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:06.440010 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:06.538954 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:06.538907 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:06.641942 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:06.641908 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:07.371592 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:07.371560 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:07.574689 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:07.574651 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:31.537472 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:31.537428 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:32.133575 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:32.133540 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:36.954425 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:36.954391 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:39.089904 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:39.089877 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:39.961665 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:39.961631 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:40.769995 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:40.769961 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:42.946138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:42.946104 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:43.404792 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:43.404758 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:46.587568 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:46.587515 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:48.554084 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:48.554049 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:48.654161 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:48.654100 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:49.014673 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:49.014585 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:49.106609 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:49.106579 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:52.342631 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:52.342564 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:52.442587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:52.442535 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:55.752246 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:55.752211 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:55.814553 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:55.814521 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:58.808733 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:58.808680 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:58.931659 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:58.931623 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:48:59.679598 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:48:59.679565 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:00.921132 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:00.921100 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:07.498095 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:07.498061 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:07.555967 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:07.555939 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:08.116127 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.116091 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:08.215753 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.215720 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:08.913824 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.913782 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj"] Jun 10 00:49:08.916840 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.916820 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:08.919636 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.919603 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 00:49:08.919752 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.919677 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 00:49:08.919818 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.919751 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x2xlt\"" Jun 10 00:49:08.928744 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.928720 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj"] Jun 10 00:49:08.971093 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.971059 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:08.971269 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:08.971123 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qm5\" (UniqueName: \"kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.072164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.072130 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.072349 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.072184 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qm5\" (UniqueName: \"kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.072571 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.072546 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.082613 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.082589 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qm5\" (UniqueName: \"kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.226978 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.226869 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:09.359877 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.359851 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj"] Jun 10 00:49:09.362847 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:49:09.362819 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f2ea84_d92e_4002_a90b_79c6308fcaf2.slice/crio-9767c293ca1ab27ff9dc95634c944ca297a7e1e49d21ee2981779d074f9e3403 WatchSource:0}: Error finding container 9767c293ca1ab27ff9dc95634c944ca297a7e1e49d21ee2981779d074f9e3403: Status 404 returned error can't find the container with id 9767c293ca1ab27ff9dc95634c944ca297a7e1e49d21ee2981779d074f9e3403 Jun 10 00:49:09.535473 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.535364 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj"] Jun 10 00:49:09.539792 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.539765 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj"] Jun 10 00:49:09.555144 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.555118 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:09.559690 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.559668 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.572020 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.571994 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:09.677461 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.677397 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.677628 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.677509 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb7f\" (UniqueName: \"kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.778457 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.778400 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.778613 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.778475 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb7f\" (UniqueName: \"kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.778776 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.778755 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.786623 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.786555 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb7f\" (UniqueName: \"kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fgfgl\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:09.869511 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:09.869479 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:10.211357 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:10.211326 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:10.301316 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:49:10.301285 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc58225_386d_4c03_baed_b27ff94be721.slice/crio-cb149cbaa37a20f20c046c06269352e78447e2204489ea9bdef47a2145349361 WatchSource:0}: Error finding container cb149cbaa37a20f20c046c06269352e78447e2204489ea9bdef47a2145349361: Status 404 returned error can't find the container with id cb149cbaa37a20f20c046c06269352e78447e2204489ea9bdef47a2145349361 Jun 10 00:49:11.174161 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:11.174126 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" event={"ID":"6cc58225-386d-4c03-baed-b27ff94be721","Type":"ContainerStarted","Data":"cb149cbaa37a20f20c046c06269352e78447e2204489ea9bdef47a2145349361"} Jun 10 00:49:11.521379 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:11.521306 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:11.620790 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:11.620760 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:13.902760 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:13.902727 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:13.950352 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:13.950317 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:16.197580 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.197466 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" containerName="manager" containerID="cri-o://a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594" gracePeriod=2 Jun 10 00:49:16.199220 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.199184 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" event={"ID":"6cc58225-386d-4c03-baed-b27ff94be721","Type":"ContainerStarted","Data":"96073ee177a0a8f475f25fd2a7026a6da367d51f54176b8d6e0c719f7e37beae"} Jun 10 00:49:16.199401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.199383 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:16.217572 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.217531 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" podStartSLOduration=1.849013193 podStartE2EDuration="7.217515322s" totalImagesPullingTime="5.368502129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:16.216364626 +0000 UTC m=+840.461823705" watchObservedRunningTime="2026-06-10 00:49:16.217515322 +0000 UTC m=+840.462974400" Jun 10 00:49:16.428540 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.428515 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:16.537797 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.537709 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume\") pod \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " Jun 10 00:49:16.537797 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.537750 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7qm5\" (UniqueName: \"kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5\") pod \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\" (UID: \"80f2ea84-d92e-4002-a90b-79c6308fcaf2\") " Jun 10 00:49:16.538039 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.538016 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80f2ea84-d92e-4002-a90b-79c6308fcaf2" (UID: "80f2ea84-d92e-4002-a90b-79c6308fcaf2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:49:16.539928 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.539896 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5" (OuterVolumeSpecName: "kube-api-access-j7qm5") pod "80f2ea84-d92e-4002-a90b-79c6308fcaf2" (UID: "80f2ea84-d92e-4002-a90b-79c6308fcaf2"). InnerVolumeSpecName "kube-api-access-j7qm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:16.638693 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.638654 2521 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80f2ea84-d92e-4002-a90b-79c6308fcaf2-extensions-socket-volume\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:49:16.638693 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:16.638686 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7qm5\" (UniqueName: \"kubernetes.io/projected/80f2ea84-d92e-4002-a90b-79c6308fcaf2-kube-api-access-j7qm5\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:49:17.204878 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:17.204838 2521 generic.go:356] "Generic (PLEG): container finished" podID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" containerID="a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594" exitCode=2 Jun 10 00:49:17.204878 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:17.204878 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:17.205351 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:17.204940 2521 scope.go:117] "RemoveContainer" containerID="a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594" Jun 10 00:49:17.207530 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:49:17.207498 2521 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" is forbidden: User \"system:node:ip-10-0-140-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-158.ec2.internal' and this object" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:17.213857 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:17.213841 2521 scope.go:117] "RemoveContainer" containerID="a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594" Jun 10 00:49:17.214111 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:49:17.214094 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594\": container with ID starting with a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594 not found: ID does not exist" containerID="a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594" Jun 10 00:49:17.214168 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:17.214123 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594"} err="failed to get container status \"a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594\": rpc error: code = NotFound desc = could not find container \"a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594\": container with ID starting with a4de35bf5732fa738fe121473ec152a105312a513cd4de4725cf7f4e98795594 not found: ID does not exist" Jun 10 00:49:17.215168 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:49:17.215146 2521 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mfklj\" is forbidden: User \"system:node:ip-10-0-140-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-158.ec2.internal' and this object" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mfklj" Jun 10 00:49:18.249503 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:18.249467 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" path="/var/lib/kubelet/pods/80f2ea84-d92e-4002-a90b-79c6308fcaf2/volumes" Jun 10 00:49:18.487102 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:18.487029 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:18.585246 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:18.585207 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:18.824510 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:18.824479 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:18.876234 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:18.876207 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:27.207314 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:27.207286 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:27.424124 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:27.424098 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:27.509578 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:27.509500 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:40.130021 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.129983 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:40.130603 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.130215 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" podUID="6cc58225-386d-4c03-baed-b27ff94be721" containerName="manager" containerID="cri-o://96073ee177a0a8f475f25fd2a7026a6da367d51f54176b8d6e0c719f7e37beae" gracePeriod=10 Jun 10 00:49:40.307867 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.307835 2521 generic.go:356] "Generic (PLEG): container finished" podID="6cc58225-386d-4c03-baed-b27ff94be721" containerID="96073ee177a0a8f475f25fd2a7026a6da367d51f54176b8d6e0c719f7e37beae" exitCode=0 Jun 10 00:49:40.308027 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.307886 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" event={"ID":"6cc58225-386d-4c03-baed-b27ff94be721","Type":"ContainerDied","Data":"96073ee177a0a8f475f25fd2a7026a6da367d51f54176b8d6e0c719f7e37beae"} Jun 10 00:49:40.373613 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.373582 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:40.547554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.547467 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume\") pod \"6cc58225-386d-4c03-baed-b27ff94be721\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " Jun 10 00:49:40.547554 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.547519 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpb7f\" (UniqueName: \"kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f\") pod \"6cc58225-386d-4c03-baed-b27ff94be721\" (UID: \"6cc58225-386d-4c03-baed-b27ff94be721\") " Jun 10 00:49:40.547834 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.547807 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cc58225-386d-4c03-baed-b27ff94be721" (UID: "6cc58225-386d-4c03-baed-b27ff94be721"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:49:40.549629 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.549605 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f" (OuterVolumeSpecName: "kube-api-access-zpb7f") pod "6cc58225-386d-4c03-baed-b27ff94be721" (UID: "6cc58225-386d-4c03-baed-b27ff94be721"). InnerVolumeSpecName "kube-api-access-zpb7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:40.648497 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.648419 2521 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cc58225-386d-4c03-baed-b27ff94be721-extensions-socket-volume\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:49:40.648497 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:40.648492 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpb7f\" (UniqueName: \"kubernetes.io/projected/6cc58225-386d-4c03-baed-b27ff94be721-kube-api-access-zpb7f\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:49:41.313820 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:41.313789 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" Jun 10 00:49:41.313820 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:41.313811 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl" event={"ID":"6cc58225-386d-4c03-baed-b27ff94be721","Type":"ContainerDied","Data":"cb149cbaa37a20f20c046c06269352e78447e2204489ea9bdef47a2145349361"} Jun 10 00:49:41.314271 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:41.313864 2521 scope.go:117] "RemoveContainer" containerID="96073ee177a0a8f475f25fd2a7026a6da367d51f54176b8d6e0c719f7e37beae" Jun 10 00:49:41.342608 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:41.342569 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:41.346748 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:41.346717 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fgfgl"] Jun 10 00:49:42.248912 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:42.248878 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc58225-386d-4c03-baed-b27ff94be721" path="/var/lib/kubelet/pods/6cc58225-386d-4c03-baed-b27ff94be721/volumes" Jun 10 00:49:43.491414 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:43.491387 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:43.592267 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:43.592235 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:47.827126 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:47.827097 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:48.156070 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.155987 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:48.162255 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162222 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:49:48.162587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162570 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc58225-386d-4c03-baed-b27ff94be721" containerName="manager" Jun 10 00:49:48.162679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162588 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc58225-386d-4c03-baed-b27ff94be721" containerName="manager" Jun 10 00:49:48.162679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162605 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" containerName="manager" Jun 10 00:49:48.162679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162613 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" containerName="manager" Jun 10 00:49:48.162679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162673 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc58225-386d-4c03-baed-b27ff94be721" containerName="manager" Jun 10 00:49:48.162854 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.162687 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f2ea84-d92e-4002-a90b-79c6308fcaf2" containerName="manager" Jun 10 00:49:48.168925 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.168899 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.171571 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.171547 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 00:49:48.171702 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.171593 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 00:49:48.171702 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.171558 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4q82l\"" Jun 10 00:49:48.173363 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.173343 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 00:49:48.174656 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.174633 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:49:48.205216 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.205182 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.205391 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.205228 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7swtp\" (UniqueName: \"kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.256952 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.256914 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:49:48.262388 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.262366 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:48.305653 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.305626 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.305812 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.305680 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7swtp\" (UniqueName: \"kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.306289 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.306268 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.311241 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.311217 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:48.313416 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.313399 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7swtp\" (UniqueName: \"kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp\") pod \"limitador-limitador-64c94fd64f-jfs4d\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.480276 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.480196 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:48.606222 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.606197 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:49:48.608826 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:49:48.608798 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc920e5_1e05_465c_9bbe_54a3d484c6a2.slice/crio-93fab1f3369535f8e47988432da60dc1792c9b366a7d0eeb15d81b9ed733af5c WatchSource:0}: Error finding container 93fab1f3369535f8e47988432da60dc1792c9b366a7d0eeb15d81b9ed733af5c: Status 404 returned error can't find the container with id 93fab1f3369535f8e47988432da60dc1792c9b366a7d0eeb15d81b9ed733af5c Jun 10 00:49:48.944368 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.944333 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:48.946922 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.946900 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:48.949688 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.949665 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-llwwl\"" Jun 10 00:49:48.954091 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.954067 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:48.978481 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:48.978430 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:49.011273 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.011234 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9fl\" (UniqueName: \"kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl\") pod \"authorino-58cd955675-jwxnk\" (UID: \"385a43ae-1164-4575-8e24-3d9c4e0e158e\") " pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:49.082610 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.082581 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:49:49.089685 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.089651 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:49:49.091724 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.091703 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:49:49.099821 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.099669 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:49:49.111911 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.111883 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9fl\" (UniqueName: \"kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl\") pod \"authorino-58cd955675-jwxnk\" (UID: \"385a43ae-1164-4575-8e24-3d9c4e0e158e\") " pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:49.112053 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.111965 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p689d\" (UniqueName: \"kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d\") pod \"authorino-75d556bd77-xv7dg\" (UID: \"b321e89a-b60d-4d1b-a87a-2c785ba75fa0\") " pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:49:49.126399 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.126371 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9fl\" (UniqueName: \"kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl\") pod \"authorino-58cd955675-jwxnk\" (UID: \"385a43ae-1164-4575-8e24-3d9c4e0e158e\") " pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:49.213343 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.213259 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p689d\" (UniqueName: \"kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d\") pod \"authorino-75d556bd77-xv7dg\" (UID: \"b321e89a-b60d-4d1b-a87a-2c785ba75fa0\") " pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:49:49.221508 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.221476 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p689d\" (UniqueName: \"kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d\") pod \"authorino-75d556bd77-xv7dg\" (UID: \"b321e89a-b60d-4d1b-a87a-2c785ba75fa0\") " pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:49:49.257941 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.257900 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:49.360239 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.360178 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" event={"ID":"8cc920e5-1e05-465c-9bbe-54a3d484c6a2","Type":"ContainerStarted","Data":"93fab1f3369535f8e47988432da60dc1792c9b366a7d0eeb15d81b9ed733af5c"} Jun 10 00:49:49.403983 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.403912 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:49:49.441002 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.440883 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:49.444670 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:49:49.444638 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod385a43ae_1164_4575_8e24_3d9c4e0e158e.slice/crio-88ece7e9c64babe235913c466c1e2b587399b586e5c14339770d2e26bfcb7796 WatchSource:0}: Error finding container 88ece7e9c64babe235913c466c1e2b587399b586e5c14339770d2e26bfcb7796: Status 404 returned error can't find the container with id 88ece7e9c64babe235913c466c1e2b587399b586e5c14339770d2e26bfcb7796 Jun 10 00:49:49.587589 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:49.587489 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:49:49.590995 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:49:49.590803 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb321e89a_b60d_4d1b_a87a_2c785ba75fa0.slice/crio-b344a8888bc480a5cf41c9b246db0670c779defff33fbacf7f25d54162d3b7bf WatchSource:0}: Error finding container b344a8888bc480a5cf41c9b246db0670c779defff33fbacf7f25d54162d3b7bf: Status 404 returned error can't find the container with id b344a8888bc480a5cf41c9b246db0670c779defff33fbacf7f25d54162d3b7bf Jun 10 00:49:50.366009 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:50.365969 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xv7dg" event={"ID":"b321e89a-b60d-4d1b-a87a-2c785ba75fa0","Type":"ContainerStarted","Data":"b344a8888bc480a5cf41c9b246db0670c779defff33fbacf7f25d54162d3b7bf"} Jun 10 00:49:50.367364 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:50.367333 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jwxnk" event={"ID":"385a43ae-1164-4575-8e24-3d9c4e0e158e","Type":"ContainerStarted","Data":"88ece7e9c64babe235913c466c1e2b587399b586e5c14339770d2e26bfcb7796"} Jun 10 00:49:52.379687 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:52.379653 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" event={"ID":"8cc920e5-1e05-465c-9bbe-54a3d484c6a2","Type":"ContainerStarted","Data":"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9"} Jun 10 00:49:52.380104 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:52.379777 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:49:52.395819 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:52.395760 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" podStartSLOduration=1.6769483649999999 podStartE2EDuration="4.395742128s" totalImagesPullingTime="2.718793763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:52.394604314 +0000 UTC m=+876.640063406" watchObservedRunningTime="2026-06-10 00:49:52.395742128 +0000 UTC m=+876.641201231" Jun 10 00:49:54.391513 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:54.391473 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jwxnk" event={"ID":"385a43ae-1164-4575-8e24-3d9c4e0e158e","Type":"ContainerStarted","Data":"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891"} Jun 10 00:49:54.392857 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:54.392828 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xv7dg" event={"ID":"b321e89a-b60d-4d1b-a87a-2c785ba75fa0","Type":"ContainerStarted","Data":"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7"} Jun 10 00:49:54.418997 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:54.418942 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jwxnk" podStartSLOduration=1.942522064 podStartE2EDuration="6.418924592s" totalImagesPullingTime="4.476402528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:54.405508722 +0000 UTC m=+878.650967803" watchObservedRunningTime="2026-06-10 00:49:54.418924592 +0000 UTC m=+878.664383700" Jun 10 00:49:54.419845 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:54.419810 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xv7dg" podStartSLOduration=1.100274701 podStartE2EDuration="5.419799067s" totalImagesPullingTime="4.319524366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:54.418729182 +0000 UTC m=+878.664188261" watchObservedRunningTime="2026-06-10 00:49:54.419799067 +0000 UTC m=+878.665258145" Jun 10 00:49:54.439910 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:54.439877 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:56.401941 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:56.401905 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jwxnk" podUID="385a43ae-1164-4575-8e24-3d9c4e0e158e" containerName="authorino" containerID="cri-o://cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891" gracePeriod=30 Jun 10 00:49:56.656518 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:56.656459 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:56.686648 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:56.686618 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr9fl\" (UniqueName: \"kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl\") pod \"385a43ae-1164-4575-8e24-3d9c4e0e158e\" (UID: \"385a43ae-1164-4575-8e24-3d9c4e0e158e\") " Jun 10 00:49:56.688647 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:56.688616 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl" (OuterVolumeSpecName: "kube-api-access-lr9fl") pod "385a43ae-1164-4575-8e24-3d9c4e0e158e" (UID: "385a43ae-1164-4575-8e24-3d9c4e0e158e"). InnerVolumeSpecName "kube-api-access-lr9fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:56.788158 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:56.788114 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr9fl\" (UniqueName: \"kubernetes.io/projected/385a43ae-1164-4575-8e24-3d9c4e0e158e-kube-api-access-lr9fl\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:49:57.407311 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.407276 2521 generic.go:356] "Generic (PLEG): container finished" podID="385a43ae-1164-4575-8e24-3d9c4e0e158e" containerID="cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891" exitCode=0 Jun 10 00:49:57.407853 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.407323 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jwxnk" Jun 10 00:49:57.407853 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.407367 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jwxnk" event={"ID":"385a43ae-1164-4575-8e24-3d9c4e0e158e","Type":"ContainerDied","Data":"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891"} Jun 10 00:49:57.407853 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.407408 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jwxnk" event={"ID":"385a43ae-1164-4575-8e24-3d9c4e0e158e","Type":"ContainerDied","Data":"88ece7e9c64babe235913c466c1e2b587399b586e5c14339770d2e26bfcb7796"} Jun 10 00:49:57.407853 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.407427 2521 scope.go:117] "RemoveContainer" containerID="cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891" Jun 10 00:49:57.415383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.415363 2521 scope.go:117] "RemoveContainer" containerID="cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891" Jun 10 00:49:57.415701 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:49:57.415682 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891\": container with ID starting with cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891 not found: ID does not exist" containerID="cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891" Jun 10 00:49:57.415769 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.415712 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891"} err="failed to get container status \"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891\": rpc error: code = NotFound desc = could not find container \"cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891\": container with ID starting with cfdbb3f4979c5273706d42764a2d34273839789ae2a82e00ee1a447d6e0bc891 not found: ID does not exist" Jun 10 00:49:57.427537 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.427507 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:57.430906 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:57.430884 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jwxnk"] Jun 10 00:49:58.249223 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:49:58.249189 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385a43ae-1164-4575-8e24-3d9c4e0e158e" path="/var/lib/kubelet/pods/385a43ae-1164-4575-8e24-3d9c4e0e158e/volumes" Jun 10 00:50:03.240645 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.240560 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:50:03.241056 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.240758 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" podUID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" containerName="limitador" containerID="cri-o://0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9" gracePeriod=30 Jun 10 00:50:03.241602 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.241575 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:50:03.793065 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.793038 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:50:03.847390 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.847356 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7swtp\" (UniqueName: \"kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp\") pod \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " Jun 10 00:50:03.847579 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.847431 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file\") pod \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\" (UID: \"8cc920e5-1e05-465c-9bbe-54a3d484c6a2\") " Jun 10 00:50:03.847773 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.847744 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file" (OuterVolumeSpecName: "config-file") pod "8cc920e5-1e05-465c-9bbe-54a3d484c6a2" (UID: "8cc920e5-1e05-465c-9bbe-54a3d484c6a2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:50:03.849416 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.849393 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp" (OuterVolumeSpecName: "kube-api-access-7swtp") pod "8cc920e5-1e05-465c-9bbe-54a3d484c6a2" (UID: "8cc920e5-1e05-465c-9bbe-54a3d484c6a2"). InnerVolumeSpecName "kube-api-access-7swtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:50:03.948885 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.948849 2521 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-config-file\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:50:03.948885 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:03.948878 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7swtp\" (UniqueName: \"kubernetes.io/projected/8cc920e5-1e05-465c-9bbe-54a3d484c6a2-kube-api-access-7swtp\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:50:04.273042 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273008 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-8ksqw"] Jun 10 00:50:04.273484 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273395 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385a43ae-1164-4575-8e24-3d9c4e0e158e" containerName="authorino" Jun 10 00:50:04.273484 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273411 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="385a43ae-1164-4575-8e24-3d9c4e0e158e" containerName="authorino" Jun 10 00:50:04.273484 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273460 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" containerName="limitador" Jun 10 00:50:04.273484 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273468 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" containerName="limitador" Jun 10 00:50:04.273692 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273548 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="385a43ae-1164-4575-8e24-3d9c4e0e158e" containerName="authorino" Jun 10 00:50:04.273692 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.273562 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" containerName="limitador" Jun 10 00:50:04.276420 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.276399 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.279245 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.279221 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m2pff\"" Jun 10 00:50:04.279363 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.279222 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 00:50:04.283810 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.283784 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-8ksqw"] Jun 10 00:50:04.306148 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.306119 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:50:04.351490 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.351425 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkx9m\" (UniqueName: \"kubernetes.io/projected/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-kube-api-access-qkx9m\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.351643 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.351541 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-data\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.436990 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.436959 2521 generic.go:356] "Generic (PLEG): container finished" podID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" containerID="0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9" exitCode=0 Jun 10 00:50:04.437162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.436996 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" Jun 10 00:50:04.437162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.437038 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" event={"ID":"8cc920e5-1e05-465c-9bbe-54a3d484c6a2","Type":"ContainerDied","Data":"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9"} Jun 10 00:50:04.437162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.437087 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jfs4d" event={"ID":"8cc920e5-1e05-465c-9bbe-54a3d484c6a2","Type":"ContainerDied","Data":"93fab1f3369535f8e47988432da60dc1792c9b366a7d0eeb15d81b9ed733af5c"} Jun 10 00:50:04.437162 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.437110 2521 scope.go:117] "RemoveContainer" containerID="0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9" Jun 10 00:50:04.449715 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.449694 2521 scope.go:117] "RemoveContainer" containerID="0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9" Jun 10 00:50:04.450012 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:50:04.449991 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9\": container with ID starting with 0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9 not found: ID does not exist" containerID="0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9" Jun 10 00:50:04.450067 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.450021 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9"} err="failed to get container status \"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9\": rpc error: code = NotFound desc = could not find container \"0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9\": container with ID starting with 0c15477504039b6b99e97f76e8c55dd2307b4b351e92912c02a422c775c4d5a9 not found: ID does not exist" Jun 10 00:50:04.452896 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.452875 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkx9m\" (UniqueName: \"kubernetes.io/projected/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-kube-api-access-qkx9m\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.452994 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.452924 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-data\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.453219 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.453204 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-data\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.462019 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.461993 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkx9m\" (UniqueName: \"kubernetes.io/projected/816b534f-99f0-4dec-b146-1f3b2f3f8ef7-kube-api-access-qkx9m\") pod \"postgres-69fb4594cf-8ksqw\" (UID: \"816b534f-99f0-4dec-b146-1f3b2f3f8ef7\") " pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.463326 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.463306 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:50:04.466739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.466717 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jfs4d"] Jun 10 00:50:04.588947 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.588919 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:04.715719 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:04.715685 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-8ksqw"] Jun 10 00:50:04.719003 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:50:04.718976 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816b534f_99f0_4dec_b146_1f3b2f3f8ef7.slice/crio-6ca2bd4d2f3de492835e9697be1f337948c16845d090be4612bbd423435d1e40 WatchSource:0}: Error finding container 6ca2bd4d2f3de492835e9697be1f337948c16845d090be4612bbd423435d1e40: Status 404 returned error can't find the container with id 6ca2bd4d2f3de492835e9697be1f337948c16845d090be4612bbd423435d1e40 Jun 10 00:50:05.442751 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:05.442714 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-8ksqw" event={"ID":"816b534f-99f0-4dec-b146-1f3b2f3f8ef7","Type":"ContainerStarted","Data":"6ca2bd4d2f3de492835e9697be1f337948c16845d090be4612bbd423435d1e40"} Jun 10 00:50:06.250195 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:06.250147 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cc920e5-1e05-465c-9bbe-54a3d484c6a2" path="/var/lib/kubelet/pods/8cc920e5-1e05-465c-9bbe-54a3d484c6a2/volumes" Jun 10 00:50:16.243317 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:16.243290 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:50:16.243898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:16.243290 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:50:26.365587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:26.365566 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 00:50:26.527248 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:26.527212 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-8ksqw" event={"ID":"816b534f-99f0-4dec-b146-1f3b2f3f8ef7","Type":"ContainerStarted","Data":"94522245e9fc3f0d651b73c27b29f5333a2d71ad61b37189e3a83d5696ec83aa"} Jun 10 00:50:26.527461 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:26.527338 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:26.544372 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:26.544322 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-8ksqw" podStartSLOduration=0.901706708 podStartE2EDuration="22.544309075s" totalImagesPullingTime="21.642602367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:50:26.542705745 +0000 UTC m=+910.788164835" watchObservedRunningTime="2026-06-10 00:50:26.544309075 +0000 UTC m=+910.789768153" Jun 10 00:50:32.560587 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:32.560559 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-8ksqw" Jun 10 00:50:32.864330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:32.864248 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:50:32.963796 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:32.963768 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:50:33.113933 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:33.113905 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:50:46.772448 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.772390 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9d64"] Jun 10 00:50:46.774961 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.774945 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" Jun 10 00:50:46.777852 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.777828 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 00:50:46.779107 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.779091 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-fztlh\"" Jun 10 00:50:46.779219 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.779119 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 00:50:46.784882 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.784860 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9d64"] Jun 10 00:50:46.808096 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.808069 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nhlg\" (UniqueName: \"kubernetes.io/projected/803fa60c-443d-4abd-9d83-beaff1c62e87-kube-api-access-2nhlg\") pod \"keycloak-operator-d67dbbb48-q9d64\" (UID: \"803fa60c-443d-4abd-9d83-beaff1c62e87\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" Jun 10 00:50:46.908509 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.908470 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nhlg\" (UniqueName: \"kubernetes.io/projected/803fa60c-443d-4abd-9d83-beaff1c62e87-kube-api-access-2nhlg\") pod \"keycloak-operator-d67dbbb48-q9d64\" (UID: \"803fa60c-443d-4abd-9d83-beaff1c62e87\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" Jun 10 00:50:46.917679 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:46.917646 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nhlg\" (UniqueName: \"kubernetes.io/projected/803fa60c-443d-4abd-9d83-beaff1c62e87-kube-api-access-2nhlg\") pod \"keycloak-operator-d67dbbb48-q9d64\" (UID: \"803fa60c-443d-4abd-9d83-beaff1c62e87\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" Jun 10 00:50:47.084581 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:47.084542 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" Jun 10 00:50:47.213687 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:47.213643 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9d64"] Jun 10 00:50:47.215724 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:50:47.215698 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803fa60c_443d_4abd_9d83_beaff1c62e87.slice/crio-35a25ca94c608e392e6fff91244cc3282840630ff7b96f9f9a1f371365b26895 WatchSource:0}: Error finding container 35a25ca94c608e392e6fff91244cc3282840630ff7b96f9f9a1f371365b26895: Status 404 returned error can't find the container with id 35a25ca94c608e392e6fff91244cc3282840630ff7b96f9f9a1f371365b26895 Jun 10 00:50:47.607977 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:47.607944 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" event={"ID":"803fa60c-443d-4abd-9d83-beaff1c62e87","Type":"ContainerStarted","Data":"35a25ca94c608e392e6fff91244cc3282840630ff7b96f9f9a1f371365b26895"} Jun 10 00:50:53.638226 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:53.638191 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" event={"ID":"803fa60c-443d-4abd-9d83-beaff1c62e87","Type":"ContainerStarted","Data":"a5ab3b0d07fdf66f2c12699a411e950e87ffea5834e24e228177410a988b06eb"} Jun 10 00:50:53.655652 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:50:53.655606 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-q9d64" podStartSLOduration=1.632624937 podStartE2EDuration="7.655590954s" totalImagesPullingTime="6.022966017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:50:53.654016985 +0000 UTC m=+937.899476064" watchObservedRunningTime="2026-06-10 00:50:53.655590954 +0000 UTC m=+937.901050033" Jun 10 00:51:01.900786 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:01.900748 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:02.001057 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:02.001023 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:31.412382 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.412348 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:31.509425 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.509394 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:31.627454 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.627416 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:31.633480 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.633464 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:31.635898 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.635869 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:31.686231 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.686148 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvt4k\" (UniqueName: \"kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k\") pod \"authorino-5d4b67c446-rpz7x\" (UID: \"2225ba50-f30e-4cc1-8a73-8b4b751a1038\") " pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:31.787017 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.786979 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvt4k\" (UniqueName: \"kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k\") pod \"authorino-5d4b67c446-rpz7x\" (UID: \"2225ba50-f30e-4cc1-8a73-8b4b751a1038\") " pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:31.795843 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.795815 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvt4k\" (UniqueName: \"kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k\") pod \"authorino-5d4b67c446-rpz7x\" (UID: \"2225ba50-f30e-4cc1-8a73-8b4b751a1038\") " pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:31.813982 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.813949 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:31.814223 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.814208 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:31.834620 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.834593 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-sp8r7"] Jun 10 00:51:31.839070 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.839050 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.841818 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.841796 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 00:51:31.844006 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.843984 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-sp8r7"] Jun 10 00:51:31.888001 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.887966 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.888160 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.888140 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxbj\" (UniqueName: \"kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.888320 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.888305 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-sp8r7"] Jun 10 00:51:31.888551 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:51:31.888533 2521 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-llxbj tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-sp8r7" podUID="5e3ffa69-ceaa-4697-8588-d82e301a96df" Jun 10 00:51:31.909860 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.909824 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:51:31.915075 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.915051 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:31.919761 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.919705 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:51:31.944000 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.943973 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:31.945972 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:51:31.945939 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2225ba50_f30e_4cc1_8a73_8b4b751a1038.slice/crio-dc39954773b36c7061979300cd082a108883a8b17f5aea8810fd8d81c25cde4d WatchSource:0}: Error finding container dc39954773b36c7061979300cd082a108883a8b17f5aea8810fd8d81c25cde4d: Status 404 returned error can't find the container with id dc39954773b36c7061979300cd082a108883a8b17f5aea8810fd8d81c25cde4d Jun 10 00:51:31.989230 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.989122 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht472\" (UniqueName: \"kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:31.989495 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.989474 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxbj\" (UniqueName: \"kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.989633 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.989619 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.989799 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.989785 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:31.993714 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.993685 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:31.998354 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:31.998326 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxbj\" (UniqueName: \"kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj\") pod \"authorino-76877994-sp8r7\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:32.090393 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.090352 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht472\" (UniqueName: \"kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:32.090614 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.090511 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:32.092947 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.092923 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:32.097641 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.097622 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht472\" (UniqueName: \"kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472\") pod \"authorino-7b9ffb564b-sxgbr\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:32.227664 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.227581 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:51:32.354914 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.354887 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:51:32.357011 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:51:32.356985 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdfea4f7_9471_4d5a_a0fc_27aab67ceb86.slice/crio-2a086a34433caf1fb4df53068724d88337e31aa6d878ffba5e77cfdad16ac820 WatchSource:0}: Error finding container 2a086a34433caf1fb4df53068724d88337e31aa6d878ffba5e77cfdad16ac820: Status 404 returned error can't find the container with id 2a086a34433caf1fb4df53068724d88337e31aa6d878ffba5e77cfdad16ac820 Jun 10 00:51:32.799544 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.799500 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" event={"ID":"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86","Type":"ContainerStarted","Data":"2a086a34433caf1fb4df53068724d88337e31aa6d878ffba5e77cfdad16ac820"} Jun 10 00:51:32.801125 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.801099 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:32.801125 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.801104 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" event={"ID":"2225ba50-f30e-4cc1-8a73-8b4b751a1038","Type":"ContainerStarted","Data":"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea"} Jun 10 00:51:32.801316 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.801141 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" event={"ID":"2225ba50-f30e-4cc1-8a73-8b4b751a1038","Type":"ContainerStarted","Data":"dc39954773b36c7061979300cd082a108883a8b17f5aea8810fd8d81c25cde4d"} Jun 10 00:51:32.801316 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.801136 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" podUID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" containerName="authorino" containerID="cri-o://b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea" gracePeriod=30 Jun 10 00:51:32.815614 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.815567 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" podStartSLOduration=1.47135539 podStartE2EDuration="1.815552475s" totalImagesPullingTime="344.197085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:51:32.814288867 +0000 UTC m=+977.059747946" watchObservedRunningTime="2026-06-10 00:51:32.815552475 +0000 UTC m=+977.061011554" Jun 10 00:51:32.874864 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.874804 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:32.897234 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.897206 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llxbj\" (UniqueName: \"kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj\") pod \"5e3ffa69-ceaa-4697-8588-d82e301a96df\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " Jun 10 00:51:32.897358 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.897271 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert\") pod \"5e3ffa69-ceaa-4697-8588-d82e301a96df\" (UID: \"5e3ffa69-ceaa-4697-8588-d82e301a96df\") " Jun 10 00:51:32.899213 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.899188 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj" (OuterVolumeSpecName: "kube-api-access-llxbj") pod "5e3ffa69-ceaa-4697-8588-d82e301a96df" (UID: "5e3ffa69-ceaa-4697-8588-d82e301a96df"). InnerVolumeSpecName "kube-api-access-llxbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:51:32.899303 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.899217 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5e3ffa69-ceaa-4697-8588-d82e301a96df" (UID: "5e3ffa69-ceaa-4697-8588-d82e301a96df"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:51:32.998291 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.998258 2521 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e3ffa69-ceaa-4697-8588-d82e301a96df-tls-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:51:32.998291 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:32.998291 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llxbj\" (UniqueName: \"kubernetes.io/projected/5e3ffa69-ceaa-4697-8588-d82e301a96df-kube-api-access-llxbj\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:51:33.037462 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.037419 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:33.098744 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.098712 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvt4k\" (UniqueName: \"kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k\") pod \"2225ba50-f30e-4cc1-8a73-8b4b751a1038\" (UID: \"2225ba50-f30e-4cc1-8a73-8b4b751a1038\") " Jun 10 00:51:33.100772 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.100740 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k" (OuterVolumeSpecName: "kube-api-access-wvt4k") pod "2225ba50-f30e-4cc1-8a73-8b4b751a1038" (UID: "2225ba50-f30e-4cc1-8a73-8b4b751a1038"). InnerVolumeSpecName "kube-api-access-wvt4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:51:33.199599 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.199564 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvt4k\" (UniqueName: \"kubernetes.io/projected/2225ba50-f30e-4cc1-8a73-8b4b751a1038-kube-api-access-wvt4k\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:51:33.807237 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.807207 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" event={"ID":"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86","Type":"ContainerStarted","Data":"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410"} Jun 10 00:51:33.808426 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808402 2521 generic.go:356] "Generic (PLEG): container finished" podID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" containerID="b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea" exitCode=0 Jun 10 00:51:33.808544 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808458 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" Jun 10 00:51:33.808544 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808490 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" event={"ID":"2225ba50-f30e-4cc1-8a73-8b4b751a1038","Type":"ContainerDied","Data":"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea"} Jun 10 00:51:33.808544 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808523 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rpz7x" event={"ID":"2225ba50-f30e-4cc1-8a73-8b4b751a1038","Type":"ContainerDied","Data":"dc39954773b36c7061979300cd082a108883a8b17f5aea8810fd8d81c25cde4d"} Jun 10 00:51:33.808645 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808545 2521 scope.go:117] "RemoveContainer" containerID="b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea" Jun 10 00:51:33.808685 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.808666 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sp8r7" Jun 10 00:51:33.819156 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.819137 2521 scope.go:117] "RemoveContainer" containerID="b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea" Jun 10 00:51:33.819424 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:51:33.819404 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea\": container with ID starting with b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea not found: ID does not exist" containerID="b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea" Jun 10 00:51:33.819527 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.819452 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea"} err="failed to get container status \"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea\": rpc error: code = NotFound desc = could not find container \"b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea\": container with ID starting with b9426d365288ae30f7385c87d3742c31e01664d83199a89229ea846e74bb12ea not found: ID does not exist" Jun 10 00:51:33.823122 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.823079 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" podStartSLOduration=2.316623988 podStartE2EDuration="2.823065253s" totalImagesPullingTime="506.441265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:51:33.82210479 +0000 UTC m=+978.067563870" watchObservedRunningTime="2026-06-10 00:51:33.823065253 +0000 UTC m=+978.068524331" Jun 10 00:51:33.845631 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.845603 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-sp8r7"] Jun 10 00:51:33.852776 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.852738 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-sp8r7"] Jun 10 00:51:33.853966 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.853945 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:51:33.854133 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.854113 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xv7dg" podUID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" containerName="authorino" containerID="cri-o://38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7" gracePeriod=30 Jun 10 00:51:33.866496 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.866463 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:33.867862 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:33.867693 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rpz7x"] Jun 10 00:51:34.095106 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.095081 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:51:34.106472 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.106420 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p689d\" (UniqueName: \"kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d\") pod \"b321e89a-b60d-4d1b-a87a-2c785ba75fa0\" (UID: \"b321e89a-b60d-4d1b-a87a-2c785ba75fa0\") " Jun 10 00:51:34.108538 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.108491 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d" (OuterVolumeSpecName: "kube-api-access-p689d") pod "b321e89a-b60d-4d1b-a87a-2c785ba75fa0" (UID: "b321e89a-b60d-4d1b-a87a-2c785ba75fa0"). InnerVolumeSpecName "kube-api-access-p689d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:51:34.207526 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.207489 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p689d\" (UniqueName: \"kubernetes.io/projected/b321e89a-b60d-4d1b-a87a-2c785ba75fa0-kube-api-access-p689d\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:51:34.249007 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.248977 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" path="/var/lib/kubelet/pods/2225ba50-f30e-4cc1-8a73-8b4b751a1038/volumes" Jun 10 00:51:34.249329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.249316 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3ffa69-ceaa-4697-8588-d82e301a96df" path="/var/lib/kubelet/pods/5e3ffa69-ceaa-4697-8588-d82e301a96df/volumes" Jun 10 00:51:34.815304 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.815263 2521 generic.go:356] "Generic (PLEG): container finished" podID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" containerID="38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7" exitCode=0 Jun 10 00:51:34.815304 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.815300 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xv7dg" Jun 10 00:51:34.815841 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.815349 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xv7dg" event={"ID":"b321e89a-b60d-4d1b-a87a-2c785ba75fa0","Type":"ContainerDied","Data":"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7"} Jun 10 00:51:34.815841 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.815381 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xv7dg" event={"ID":"b321e89a-b60d-4d1b-a87a-2c785ba75fa0","Type":"ContainerDied","Data":"b344a8888bc480a5cf41c9b246db0670c779defff33fbacf7f25d54162d3b7bf"} Jun 10 00:51:34.815841 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.815403 2521 scope.go:117] "RemoveContainer" containerID="38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7" Jun 10 00:51:34.823700 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.823680 2521 scope.go:117] "RemoveContainer" containerID="38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7" Jun 10 00:51:34.823949 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:51:34.823932 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7\": container with ID starting with 38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7 not found: ID does not exist" containerID="38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7" Jun 10 00:51:34.824004 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.823959 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7"} err="failed to get container status \"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7\": rpc error: code = NotFound desc = could not find container \"38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7\": container with ID starting with 38ff660f58206b190d84995dcb9d8c7949ab03256f92484dc96d74f5e93006f7 not found: ID does not exist" Jun 10 00:51:34.831784 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.831755 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:51:34.837330 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:34.837308 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xv7dg"] Jun 10 00:51:35.027779 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:35.027742 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:36.248739 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:36.248705 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" path="/var/lib/kubelet/pods/b321e89a-b60d-4d1b-a87a-2c785ba75fa0/volumes" Jun 10 00:51:37.374189 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:37.374158 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:37.471482 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:37.471453 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:37.572993 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:37.572964 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:37.625322 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:37.625241 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:40.598364 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:40.598327 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:51:40.697663 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:51:40.697630 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:52:11.614030 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:52:11.614003 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:52:11.871829 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:52:11.871753 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:52:12.009015 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:52:12.008985 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:52:12.099545 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:52:12.099510 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:52:47.012198 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:52:47.012169 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:53:09.343031 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.342958 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343285 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" containerName="authorino" Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343299 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" containerName="authorino" Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343321 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" containerName="authorino" Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343326 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" containerName="authorino" Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343371 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="2225ba50-f30e-4cc1-8a73-8b4b751a1038" containerName="authorino" Jun 10 00:53:09.343383 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.343380 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="b321e89a-b60d-4d1b-a87a-2c785ba75fa0" containerName="authorino" Jun 10 00:53:09.346154 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.346139 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.348889 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.348869 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 00:53:09.354750 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.354703 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:53:09.413793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.413756 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2z4l\" (UniqueName: \"kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.413793 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.413795 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.413993 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.413886 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.514671 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.514637 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.514826 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.514683 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2z4l\" (UniqueName: \"kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.514826 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.514717 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.515352 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.515332 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.517101 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.517080 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.522885 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.522869 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2z4l\" (UniqueName: \"kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l\") pod \"authorino-5b6dcd5748-8nnkg\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.655923 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.655833 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:53:09.782957 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.781104 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:53:09.785402 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:53:09.785375 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55211910_428a_4a9f_b039_c3af4f712c57.slice/crio-6aaa79d23003d3c4c1636ae8b30d52679e640ca10bdbd17c2fd0599396860cc4 WatchSource:0}: Error finding container 6aaa79d23003d3c4c1636ae8b30d52679e640ca10bdbd17c2fd0599396860cc4: Status 404 returned error can't find the container with id 6aaa79d23003d3c4c1636ae8b30d52679e640ca10bdbd17c2fd0599396860cc4 Jun 10 00:53:09.786909 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:09.786888 2521 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:53:10.214827 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:10.214788 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" event={"ID":"55211910-428a-4a9f-b039-c3af4f712c57","Type":"ContainerStarted","Data":"6aaa79d23003d3c4c1636ae8b30d52679e640ca10bdbd17c2fd0599396860cc4"} Jun 10 00:53:11.220061 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.220027 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" event={"ID":"55211910-428a-4a9f-b039-c3af4f712c57","Type":"ContainerStarted","Data":"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7"} Jun 10 00:53:11.235362 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.235312 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" podStartSLOduration=1.851852475 podStartE2EDuration="2.235295133s" totalImagesPullingTime="383.442658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:53:11.234536734 +0000 UTC m=+1075.479995815" watchObservedRunningTime="2026-06-10 00:53:11.235295133 +0000 UTC m=+1075.480754212" Jun 10 00:53:11.258251 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.258214 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:53:11.258486 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.258451 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" podUID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" containerName="authorino" containerID="cri-o://4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410" gracePeriod=30 Jun 10 00:53:11.510217 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.510188 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:53:11.526831 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.526806 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht472\" (UniqueName: \"kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472\") pod \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " Jun 10 00:53:11.526987 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.526845 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert\") pod \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\" (UID: \"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86\") " Jun 10 00:53:11.529136 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.529107 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472" (OuterVolumeSpecName: "kube-api-access-ht472") pod "cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" (UID: "cdfea4f7-9471-4d5a-a0fc-27aab67ceb86"). InnerVolumeSpecName "kube-api-access-ht472". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:53:11.536339 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.536313 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" (UID: "cdfea4f7-9471-4d5a-a0fc-27aab67ceb86"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:53:11.627875 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.627846 2521 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-tls-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:53:11.627875 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.627871 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht472\" (UniqueName: \"kubernetes.io/projected/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86-kube-api-access-ht472\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:53:11.671265 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.671221 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:53:11.771096 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:11.771011 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:53:12.225685 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.225653 2521 generic.go:356] "Generic (PLEG): container finished" podID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" containerID="4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410" exitCode=0 Jun 10 00:53:12.226090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.225702 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" Jun 10 00:53:12.226090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.225740 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" event={"ID":"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86","Type":"ContainerDied","Data":"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410"} Jun 10 00:53:12.226090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.225784 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9ffb564b-sxgbr" event={"ID":"cdfea4f7-9471-4d5a-a0fc-27aab67ceb86","Type":"ContainerDied","Data":"2a086a34433caf1fb4df53068724d88337e31aa6d878ffba5e77cfdad16ac820"} Jun 10 00:53:12.226090 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.225807 2521 scope.go:117] "RemoveContainer" containerID="4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410" Jun 10 00:53:12.234265 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.234239 2521 scope.go:117] "RemoveContainer" containerID="4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410" Jun 10 00:53:12.234541 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:53:12.234521 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410\": container with ID starting with 4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410 not found: ID does not exist" containerID="4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410" Jun 10 00:53:12.234624 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.234553 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410"} err="failed to get container status \"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410\": rpc error: code = NotFound desc = could not find container \"4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410\": container with ID starting with 4bb99ff11a6d55fa433760d38e9447c78fe5eaefc56f22ce50767577f487c410 not found: ID does not exist" Jun 10 00:53:12.249776 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.249754 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:53:12.249919 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:12.249784 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b9ffb564b-sxgbr"] Jun 10 00:53:14.248669 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:14.248635 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" path="/var/lib/kubelet/pods/cdfea4f7-9471-4d5a-a0fc-27aab67ceb86/volumes" Jun 10 00:53:15.076921 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:15.076880 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:53:39.224707 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:39.224674 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:53:49.601929 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:53:49.601893 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:54:05.297612 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:54:05.297574 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:54:15.511401 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:54:15.511365 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:54:28.214625 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:54:28.214587 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:54:37.950295 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:54:37.950258 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:54:50.687962 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:54:50.687929 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:55:05.504073 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:55:05.504041 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:55:10.572562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:55:10.572518 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:55:16.266989 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:55:16.266960 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:55:16.267510 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:55:16.267194 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 00:56:09.696207 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.696124 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86f8897ccc-jrlq7"] Jun 10 00:56:09.698698 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.696460 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" containerName="authorino" Jun 10 00:56:09.698698 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.696473 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" containerName="authorino" Jun 10 00:56:09.698698 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.696524 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfea4f7-9471-4d5a-a0fc-27aab67ceb86" containerName="authorino" Jun 10 00:56:09.699536 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.699520 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.705915 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.705891 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86f8897ccc-jrlq7"] Jun 10 00:56:09.717296 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.717270 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694ab43-3281-41e8-87a8-2ffa9db00f83-tls-cert\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.717417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.717312 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zd76\" (UniqueName: \"kubernetes.io/projected/b694ab43-3281-41e8-87a8-2ffa9db00f83-kube-api-access-5zd76\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.717417 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.717361 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b694ab43-3281-41e8-87a8-2ffa9db00f83-oidc-ca\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.818010 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.817970 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694ab43-3281-41e8-87a8-2ffa9db00f83-tls-cert\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.818187 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.818023 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zd76\" (UniqueName: \"kubernetes.io/projected/b694ab43-3281-41e8-87a8-2ffa9db00f83-kube-api-access-5zd76\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.818187 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.818073 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b694ab43-3281-41e8-87a8-2ffa9db00f83-oidc-ca\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.818755 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.818734 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b694ab43-3281-41e8-87a8-2ffa9db00f83-oidc-ca\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.820632 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.820609 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b694ab43-3281-41e8-87a8-2ffa9db00f83-tls-cert\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:09.825868 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:09.825847 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zd76\" (UniqueName: \"kubernetes.io/projected/b694ab43-3281-41e8-87a8-2ffa9db00f83-kube-api-access-5zd76\") pod \"authorino-86f8897ccc-jrlq7\" (UID: \"b694ab43-3281-41e8-87a8-2ffa9db00f83\") " pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:10.009562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.009479 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86f8897ccc-jrlq7" Jun 10 00:56:10.134721 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.134696 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86f8897ccc-jrlq7"] Jun 10 00:56:10.136945 ip-10-0-140-158 kubenswrapper[2521]: W0610 00:56:10.136920 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb694ab43_3281_41e8_87a8_2ffa9db00f83.slice/crio-c2270f6c0005b3155017fdd6aa4f471df7e8a23cbab933cb49046b6ef7fe9bb8 WatchSource:0}: Error finding container c2270f6c0005b3155017fdd6aa4f471df7e8a23cbab933cb49046b6ef7fe9bb8: Status 404 returned error can't find the container with id c2270f6c0005b3155017fdd6aa4f471df7e8a23cbab933cb49046b6ef7fe9bb8 Jun 10 00:56:10.204893 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.204851 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:56:10.304644 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.304597 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:56:10.943883 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.943786 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86f8897ccc-jrlq7" event={"ID":"b694ab43-3281-41e8-87a8-2ffa9db00f83","Type":"ContainerStarted","Data":"c820846c11b7bf7f3ccef952d9c23b475c7084be5226eee2bb6fb1651227c108"} Jun 10 00:56:10.943883 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.943826 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86f8897ccc-jrlq7" event={"ID":"b694ab43-3281-41e8-87a8-2ffa9db00f83","Type":"ContainerStarted","Data":"c2270f6c0005b3155017fdd6aa4f471df7e8a23cbab933cb49046b6ef7fe9bb8"} Jun 10 00:56:10.996464 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.995958 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86f8897ccc-jrlq7" podStartSLOduration=1.5621354859999999 podStartE2EDuration="1.995934463s" totalImagesPullingTime="433.798977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:56:10.965742012 +0000 UTC m=+1255.211201094" watchObservedRunningTime="2026-06-10 00:56:10.995934463 +0000 UTC m=+1255.241393544" Jun 10 00:56:10.997786 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.997748 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:56:10.998159 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:10.997928 2521 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" podUID="55211910-428a-4a9f-b039-c3af4f712c57" containerName="authorino" containerID="cri-o://6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7" gracePeriod=30 Jun 10 00:56:11.236329 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.236305 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:56:11.288154 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.288122 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:56:11.330975 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.330942 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2z4l\" (UniqueName: \"kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l\") pod \"55211910-428a-4a9f-b039-c3af4f712c57\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " Jun 10 00:56:11.331138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.330999 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca\") pod \"55211910-428a-4a9f-b039-c3af4f712c57\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " Jun 10 00:56:11.331138 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.331036 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert\") pod \"55211910-428a-4a9f-b039-c3af4f712c57\" (UID: \"55211910-428a-4a9f-b039-c3af4f712c57\") " Jun 10 00:56:11.333164 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.333137 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l" (OuterVolumeSpecName: "kube-api-access-k2z4l") pod "55211910-428a-4a9f-b039-c3af4f712c57" (UID: "55211910-428a-4a9f-b039-c3af4f712c57"). InnerVolumeSpecName "kube-api-access-k2z4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:56:11.335301 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.335269 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "55211910-428a-4a9f-b039-c3af4f712c57" (UID: "55211910-428a-4a9f-b039-c3af4f712c57"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:56:11.339777 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.339754 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "55211910-428a-4a9f-b039-c3af4f712c57" (UID: "55211910-428a-4a9f-b039-c3af4f712c57"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:56:11.388182 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.388148 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:56:11.431855 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.431823 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2z4l\" (UniqueName: \"kubernetes.io/projected/55211910-428a-4a9f-b039-c3af4f712c57-kube-api-access-k2z4l\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:56:11.431855 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.431852 2521 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/55211910-428a-4a9f-b039-c3af4f712c57-oidc-ca\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:56:11.432003 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.431862 2521 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55211910-428a-4a9f-b039-c3af4f712c57-tls-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 00:56:11.949078 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.949045 2521 generic.go:356] "Generic (PLEG): container finished" podID="55211910-428a-4a9f-b039-c3af4f712c57" containerID="6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7" exitCode=0 Jun 10 00:56:11.949562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.949102 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" Jun 10 00:56:11.949562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.949131 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" event={"ID":"55211910-428a-4a9f-b039-c3af4f712c57","Type":"ContainerDied","Data":"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7"} Jun 10 00:56:11.949562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.949167 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6dcd5748-8nnkg" event={"ID":"55211910-428a-4a9f-b039-c3af4f712c57","Type":"ContainerDied","Data":"6aaa79d23003d3c4c1636ae8b30d52679e640ca10bdbd17c2fd0599396860cc4"} Jun 10 00:56:11.949562 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.949183 2521 scope.go:117] "RemoveContainer" containerID="6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7" Jun 10 00:56:11.958270 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.958208 2521 scope.go:117] "RemoveContainer" containerID="6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7" Jun 10 00:56:11.958541 ip-10-0-140-158 kubenswrapper[2521]: E0610 00:56:11.958518 2521 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7\": container with ID starting with 6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7 not found: ID does not exist" containerID="6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7" Jun 10 00:56:11.958637 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.958551 2521 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7"} err="failed to get container status \"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7\": rpc error: code = NotFound desc = could not find container \"6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7\": container with ID starting with 6657bd32cfc550b1b49b2eefe069db4821431c547df6c45c8eb3ee28822542b7 not found: ID does not exist" Jun 10 00:56:11.972181 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.972152 2521 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:56:11.983466 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:11.983403 2521 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b6dcd5748-8nnkg"] Jun 10 00:56:12.248992 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:56:12.248911 2521 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55211910-428a-4a9f-b039-c3af4f712c57" path="/var/lib/kubelet/pods/55211910-428a-4a9f-b039-c3af4f712c57/volumes" Jun 10 00:57:37.662064 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:57:37.662026 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:57:39.944286 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:57:39.944256 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:19.068033 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:19.067992 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:19.166607 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:19.166573 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:27.562295 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:27.562212 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:33.146748 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:33.146709 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:33.257108 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:33.257069 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:34.914703 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:34.914668 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:58:54.848927 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:58:54.848887 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:05.304934 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:05.304851 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:05.404273 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:05.404240 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:29.397800 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:29.397766 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.168063 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.168033 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.253628 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.253595 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.336748 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.336704 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.436190 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.436107 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.538147 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.538113 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:35.638341 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:35.638309 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:52.258402 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:52.258370 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:52.364563 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:52.364525 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:52.478179 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:52.478151 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:58.574702 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:58.574671 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 00:59:58.676969 ip-10-0-140-158 kubenswrapper[2521]: I0610 00:59:58.676936 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:00.146454 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.146398 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684220-6vd92"] Jun 10 01:00:00.146867 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.146737 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55211910-428a-4a9f-b039-c3af4f712c57" containerName="authorino" Jun 10 01:00:00.146867 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.146748 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="55211910-428a-4a9f-b039-c3af4f712c57" containerName="authorino" Jun 10 01:00:00.146867 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.146799 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="55211910-428a-4a9f-b039-c3af4f712c57" containerName="authorino" Jun 10 01:00:00.149620 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.149601 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:00.152461 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.152428 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftnqq\"" Jun 10 01:00:00.165160 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.165131 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684220-6vd92"] Jun 10 01:00:00.284179 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.284134 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d69k\" (UniqueName: \"kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k\") pod \"maas-api-key-cleanup-29684220-6vd92\" (UID: \"564d9449-9436-465e-85f7-117e59345aa2\") " pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:00.385115 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.385072 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d69k\" (UniqueName: \"kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k\") pod \"maas-api-key-cleanup-29684220-6vd92\" (UID: \"564d9449-9436-465e-85f7-117e59345aa2\") " pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:00.394094 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.394069 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d69k\" (UniqueName: \"kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k\") pod \"maas-api-key-cleanup-29684220-6vd92\" (UID: \"564d9449-9436-465e-85f7-117e59345aa2\") " pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:00.459605 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.459530 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:00.586153 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.586090 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684220-6vd92"] Jun 10 01:00:00.588320 ip-10-0-140-158 kubenswrapper[2521]: W0610 01:00:00.588290 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564d9449_9436_465e_85f7_117e59345aa2.slice/crio-695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac WatchSource:0}: Error finding container 695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac: Status 404 returned error can't find the container with id 695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac Jun 10 01:00:00.590120 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.590105 2521 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:00:00.881108 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:00.881073 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" event={"ID":"564d9449-9436-465e-85f7-117e59345aa2","Type":"ContainerStarted","Data":"695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac"} Jun 10 01:00:06.736724 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:06.736691 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:06.827730 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:06.827688 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:06.966851 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:06.966819 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:07.093274 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:07.093246 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:16.298698 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:16.298671 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:00:16.299588 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:16.299563 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:00:17.958889 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:17.958849 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" event={"ID":"564d9449-9436-465e-85f7-117e59345aa2","Type":"ContainerStarted","Data":"233e9050cefd319f6cd272c5e860ba1dbdef01e0a58644a484b4db990bc6bfaf"} Jun 10 01:00:17.973946 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:17.973895 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" podStartSLOduration=1.288643332 podStartE2EDuration="17.973880096s" totalImagesPullingTime="16.685236764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:00:17.973307893 +0000 UTC m=+1502.218766974" watchObservedRunningTime="2026-06-10 01:00:17.973880096 +0000 UTC m=+1502.219339175" Jun 10 01:00:18.964460 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:18.964415 2521 generic.go:356] "Generic (PLEG): container finished" podID="564d9449-9436-465e-85f7-117e59345aa2" containerID="233e9050cefd319f6cd272c5e860ba1dbdef01e0a58644a484b4db990bc6bfaf" exitCode=0 Jun 10 01:00:18.964851 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:18.964499 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" event={"ID":"564d9449-9436-465e-85f7-117e59345aa2","Type":"ContainerDied","Data":"233e9050cefd319f6cd272c5e860ba1dbdef01e0a58644a484b4db990bc6bfaf"} Jun 10 01:00:20.094810 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.094789 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:20.160706 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.160676 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d69k\" (UniqueName: \"kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k\") pod \"564d9449-9436-465e-85f7-117e59345aa2\" (UID: \"564d9449-9436-465e-85f7-117e59345aa2\") " Jun 10 01:00:20.162828 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.162804 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k" (OuterVolumeSpecName: "kube-api-access-4d69k") pod "564d9449-9436-465e-85f7-117e59345aa2" (UID: "564d9449-9436-465e-85f7-117e59345aa2"). InnerVolumeSpecName "kube-api-access-4d69k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:00:20.261627 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.261603 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d69k\" (UniqueName: \"kubernetes.io/projected/564d9449-9436-465e-85f7-117e59345aa2-kube-api-access-4d69k\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 01:00:20.973365 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.973327 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" event={"ID":"564d9449-9436-465e-85f7-117e59345aa2","Type":"ContainerDied","Data":"695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac"} Jun 10 01:00:20.973365 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.973352 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684220-6vd92" Jun 10 01:00:20.973595 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:20.973382 2521 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="695b5173adef6da8185dad6d405058078ad8f753e9763bfc0a7f5efe0fc7a7ac" Jun 10 01:00:23.617676 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:23.617646 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:23.740101 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:23.740073 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:23.864062 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:23.864027 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:29.417475 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:29.417428 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:29.477527 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:29.477497 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:52.096802 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:52.096763 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:52.194404 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:52.194368 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:52.320337 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:52.320291 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:57.950673 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:57.950624 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:58.055318 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:58.055284 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:58.154233 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:58.154201 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:00:58.308268 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:00:58.308239 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:03.871832 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:01:03.871793 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:03.924562 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:01:03.924518 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:01:30.697896 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:01:30.697860 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:03:43.319907 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:03:43.319871 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:05.416844 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:05:05.416764 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:06.407054 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:05:06.407014 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:05:16.322615 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:05:16.322589 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:05:16.324367 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:05:16.324347 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:09:13.261334 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.261296 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8"] Jun 10 01:09:13.261828 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.261647 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="564d9449-9436-465e-85f7-117e59345aa2" containerName="cleanup" Jun 10 01:09:13.261828 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.261660 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="564d9449-9436-465e-85f7-117e59345aa2" containerName="cleanup" Jun 10 01:09:13.261828 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.261725 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="564d9449-9436-465e-85f7-117e59345aa2" containerName="cleanup" Jun 10 01:09:13.264764 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.264748 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.269818 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.269796 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x2xlt\"" Jun 10 01:09:13.277217 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.277188 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8"] Jun 10 01:09:13.332485 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.332410 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ebdd4f0-aa99-421d-9e87-98af9339a899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.332679 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.332579 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27pn\" (UniqueName: \"kubernetes.io/projected/0ebdd4f0-aa99-421d-9e87-98af9339a899-kube-api-access-k27pn\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.433735 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.433697 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k27pn\" (UniqueName: \"kubernetes.io/projected/0ebdd4f0-aa99-421d-9e87-98af9339a899-kube-api-access-k27pn\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.433911 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.433771 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ebdd4f0-aa99-421d-9e87-98af9339a899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.434201 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.434181 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ebdd4f0-aa99-421d-9e87-98af9339a899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.445618 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.445588 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27pn\" (UniqueName: \"kubernetes.io/projected/0ebdd4f0-aa99-421d-9e87-98af9339a899-kube-api-access-k27pn\") pod \"kuadrant-operator-controller-manager-86878c769f-7ccj8\" (UID: \"0ebdd4f0-aa99-421d-9e87-98af9339a899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.575213 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.575175 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:13.713989 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:13.713962 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8"] Jun 10 01:09:13.716880 ip-10-0-140-158 kubenswrapper[2521]: W0610 01:09:13.716856 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebdd4f0_aa99_421d_9e87_98af9339a899.slice/crio-2b0b9008ab271b371beb00588da6ddf39cb170a7a5db57080f264eabcd8ae516 WatchSource:0}: Error finding container 2b0b9008ab271b371beb00588da6ddf39cb170a7a5db57080f264eabcd8ae516: Status 404 returned error can't find the container with id 2b0b9008ab271b371beb00588da6ddf39cb170a7a5db57080f264eabcd8ae516 Jun 10 01:09:14.165647 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:14.165610 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" event={"ID":"0ebdd4f0-aa99-421d-9e87-98af9339a899","Type":"ContainerStarted","Data":"55173292f109610c60c5c3ac74631eddecbd2bbe308082d60d0b4e5019350d31"} Jun 10 01:09:14.165836 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:14.165667 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" event={"ID":"0ebdd4f0-aa99-421d-9e87-98af9339a899","Type":"ContainerStarted","Data":"2b0b9008ab271b371beb00588da6ddf39cb170a7a5db57080f264eabcd8ae516"} Jun 10 01:09:14.165836 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:14.165710 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:14.186869 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:14.186816 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" podStartSLOduration=1.186798245 podStartE2EDuration="1.186798245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:09:14.186627442 +0000 UTC m=+2038.432086522" watchObservedRunningTime="2026-06-10 01:09:14.186798245 +0000 UTC m=+2038.432257307" Jun 10 01:09:25.172027 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:25.171990 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7ccj8" Jun 10 01:09:32.222399 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:32.222365 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:09:32.308387 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:09:32.308355 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:10:16.351679 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:10:16.351652 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:10:16.352772 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:10:16.352742 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:11:22.790332 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:11:22.790252 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:00.135262 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.135226 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-n28m7"] Jun 10 01:15:00.138930 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.138915 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:00.141646 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.141628 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftnqq\"" Jun 10 01:15:00.152966 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.152941 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-n28m7"] Jun 10 01:15:00.240734 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.240688 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhlk\" (UniqueName: \"kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk\") pod \"maas-api-key-cleanup-29684235-n28m7\" (UID: \"6ec30f35-6163-4bd4-b66b-1a358213de1a\") " pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:00.341519 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.341482 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhlk\" (UniqueName: \"kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk\") pod \"maas-api-key-cleanup-29684235-n28m7\" (UID: \"6ec30f35-6163-4bd4-b66b-1a358213de1a\") " pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:00.349638 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.349615 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhlk\" (UniqueName: \"kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk\") pod \"maas-api-key-cleanup-29684235-n28m7\" (UID: \"6ec30f35-6163-4bd4-b66b-1a358213de1a\") " pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:00.448736 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.448646 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:00.574906 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.574882 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684235-n28m7"] Jun 10 01:15:00.577560 ip-10-0-140-158 kubenswrapper[2521]: W0610 01:15:00.577531 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec30f35_6163_4bd4_b66b_1a358213de1a.slice/crio-8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d WatchSource:0}: Error finding container 8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d: Status 404 returned error can't find the container with id 8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d Jun 10 01:15:00.632308 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:00.632279 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" event={"ID":"6ec30f35-6163-4bd4-b66b-1a358213de1a","Type":"ContainerStarted","Data":"8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d"} Jun 10 01:15:01.638398 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:01.638362 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" event={"ID":"6ec30f35-6163-4bd4-b66b-1a358213de1a","Type":"ContainerStarted","Data":"dc0190ea1201ce14d6eeb435097b7f84d063c86c233c421f8d3032ab1644f132"} Jun 10 01:15:01.656071 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:01.656019 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" podStartSLOduration=1.656002296 podStartE2EDuration="1.656002296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:01.653662412 +0000 UTC m=+2385.899121491" watchObservedRunningTime="2026-06-10 01:15:01.656002296 +0000 UTC m=+2385.901461378" Jun 10 01:15:02.644302 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:02.644263 2521 generic.go:356] "Generic (PLEG): container finished" podID="6ec30f35-6163-4bd4-b66b-1a358213de1a" containerID="dc0190ea1201ce14d6eeb435097b7f84d063c86c233c421f8d3032ab1644f132" exitCode=0 Jun 10 01:15:02.644736 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:02.644343 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" event={"ID":"6ec30f35-6163-4bd4-b66b-1a358213de1a","Type":"ContainerDied","Data":"dc0190ea1201ce14d6eeb435097b7f84d063c86c233c421f8d3032ab1644f132"} Jun 10 01:15:03.778527 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:03.778503 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:03.872689 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:03.872654 2521 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rhlk\" (UniqueName: \"kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk\") pod \"6ec30f35-6163-4bd4-b66b-1a358213de1a\" (UID: \"6ec30f35-6163-4bd4-b66b-1a358213de1a\") " Jun 10 01:15:03.874720 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:03.874689 2521 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk" (OuterVolumeSpecName: "kube-api-access-5rhlk") pod "6ec30f35-6163-4bd4-b66b-1a358213de1a" (UID: "6ec30f35-6163-4bd4-b66b-1a358213de1a"). InnerVolumeSpecName "kube-api-access-5rhlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:15:03.973313 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:03.973228 2521 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rhlk\" (UniqueName: \"kubernetes.io/projected/6ec30f35-6163-4bd4-b66b-1a358213de1a-kube-api-access-5rhlk\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Jun 10 01:15:04.654595 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:04.654561 2521 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" Jun 10 01:15:04.654770 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:04.654588 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684235-n28m7" event={"ID":"6ec30f35-6163-4bd4-b66b-1a358213de1a","Type":"ContainerDied","Data":"8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d"} Jun 10 01:15:04.654770 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:04.654636 2521 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dad262fc433936e9c268149357269a44d9296f07cea236bc522b615ef739a8d" Jun 10 01:15:16.382257 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:16.382226 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:15:16.383561 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:16.383539 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-znzd6_cf9348a1-5c89-430a-9ab5-f601ffa78bda/ovn-acl-logging/0.log" Jun 10 01:15:34.675892 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:34.675862 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:15:34.722687 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:15:34.722659 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:16:49.012742 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:16:49.012709 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:17:56.701300 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:17:56.701266 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:02.158405 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:02.158370 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:26.403165 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:26.403122 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:39.477638 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:39.477579 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:41.158623 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:41.158587 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:41.256290 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:41.256255 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:41.355271 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:41.355237 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:41.458220 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:41.458139 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:44.705893 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:44.705864 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:47.405597 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:47.405564 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:47.593622 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:47.593592 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:47.695691 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:47.695602 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:49.441548 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:49.441503 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:53.617573 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:53.617528 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:53.670826 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:53.670799 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:53.815053 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:53.815019 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:53.914802 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:53.914721 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:54.014883 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:54.014851 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:54.114893 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:54.114864 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:18:57.256119 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:18:57.256089 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:00.098475 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:00.098419 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:01.298394 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:01.298330 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:01.398153 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:01.398120 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:04.176254 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:04.176223 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:07.010481 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:07.010432 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:07.110362 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:07.110327 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:13.345518 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:13.345483 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86f8897ccc-jrlq7_b694ab43-3281-41e8-87a8-2ffa9db00f83/authorino/0.log" Jun 10 01:19:18.514294 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:18.514258 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684220-6vd92_564d9449-9436-465e-85f7-117e59345aa2/cleanup/0.log" Jun 10 01:19:18.622799 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:18.622770 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684235-n28m7_6ec30f35-6163-4bd4-b66b-1a358213de1a/cleanup/0.log" Jun 10 01:19:19.211349 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:19.211319 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-j8k6r_3923f78f-074b-4802-bf4d-d54f2cb0c3c3/copy-manifests/0.log" Jun 10 01:19:19.227519 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:19.227488 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-j8k6r_3923f78f-074b-4802-bf4d-d54f2cb0c3c3/manager/0.log" Jun 10 01:19:19.466885 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:19.466807 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-8ksqw_816b534f-99f0-4dec-b146-1f3b2f3f8ef7/postgres/0.log" Jun 10 01:19:20.735169 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:20.735138 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86f8897ccc-jrlq7_b694ab43-3281-41e8-87a8-2ffa9db00f83/authorino/0.log" Jun 10 01:19:21.318786 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:21.318754 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7ccj8_0ebdd4f0-aa99-421d-9e87-98af9339a899/manager/0.log" Jun 10 01:19:22.156100 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:22.156071 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-4gt7c_051aaa2a-aafc-45f4-8338-d504dd128cad/kube-auth-proxy/0.log" Jun 10 01:19:28.017649 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.017610 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5p9k/must-gather-bxbzr"] Jun 10 01:19:28.018103 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.017954 2521 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec30f35-6163-4bd4-b66b-1a358213de1a" containerName="cleanup" Jun 10 01:19:28.018103 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.017966 2521 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec30f35-6163-4bd4-b66b-1a358213de1a" containerName="cleanup" Jun 10 01:19:28.018103 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.018021 2521 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec30f35-6163-4bd4-b66b-1a358213de1a" containerName="cleanup" Jun 10 01:19:28.020978 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.020958 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.023875 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.023855 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"kube-root-ca.crt\"" Jun 10 01:19:28.023875 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.023867 2521 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"openshift-service-ca.crt\"" Jun 10 01:19:28.025239 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.025212 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18c7115c-bd93-409b-8165-54e90f86d059-must-gather-output\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.025360 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.025263 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjrx\" (UniqueName: \"kubernetes.io/projected/18c7115c-bd93-409b-8165-54e90f86d059-kube-api-access-qcjrx\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.025452 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.025340 2521 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f5p9k\"/\"default-dockercfg-98wnl\"" Jun 10 01:19:28.029972 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.029947 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/must-gather-bxbzr"] Jun 10 01:19:28.030313 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.030287 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:28.126324 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.126277 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjrx\" (UniqueName: \"kubernetes.io/projected/18c7115c-bd93-409b-8165-54e90f86d059-kube-api-access-qcjrx\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.126541 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.126339 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18c7115c-bd93-409b-8165-54e90f86d059-must-gather-output\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.126687 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.126671 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18c7115c-bd93-409b-8165-54e90f86d059-must-gather-output\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.129967 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.129943 2521 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" limit=1024 Jun 10 01:19:28.134654 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.134632 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjrx\" (UniqueName: \"kubernetes.io/projected/18c7115c-bd93-409b-8165-54e90f86d059-kube-api-access-qcjrx\") pod \"must-gather-bxbzr\" (UID: \"18c7115c-bd93-409b-8165-54e90f86d059\") " pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.330171 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.330142 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" Jun 10 01:19:28.457683 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.457657 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/must-gather-bxbzr"] Jun 10 01:19:28.459927 ip-10-0-140-158 kubenswrapper[2521]: W0610 01:19:28.459900 2521 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18c7115c_bd93_409b_8165_54e90f86d059.slice/crio-c22cccffd942f5f0fff40f1224be2cab7815854f5d4e340c7e55aabf9585999e WatchSource:0}: Error finding container c22cccffd942f5f0fff40f1224be2cab7815854f5d4e340c7e55aabf9585999e: Status 404 returned error can't find the container with id c22cccffd942f5f0fff40f1224be2cab7815854f5d4e340c7e55aabf9585999e Jun 10 01:19:28.461772 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.461758 2521 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:19:28.792914 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:28.792830 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" event={"ID":"18c7115c-bd93-409b-8165-54e90f86d059","Type":"ContainerStarted","Data":"c22cccffd942f5f0fff40f1224be2cab7815854f5d4e340c7e55aabf9585999e"} Jun 10 01:19:29.800055 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:29.800024 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" event={"ID":"18c7115c-bd93-409b-8165-54e90f86d059","Type":"ContainerStarted","Data":"0a15bd25c7a3a8b970777f946e96a781570a9111fa65f9cfa24705945271e834"} Jun 10 01:19:30.806654 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:30.806606 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" event={"ID":"18c7115c-bd93-409b-8165-54e90f86d059","Type":"ContainerStarted","Data":"eae65797ae61c72e1fdcfe5b0153670cce75b2a29f361405f37fb137407d4e57"} Jun 10 01:19:30.824381 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:30.824316 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5p9k/must-gather-bxbzr" podStartSLOduration=1.5905432099999999 podStartE2EDuration="2.824295517s" totalImagesPullingTime="1.233752307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:30.822310389 +0000 UTC m=+2655.067769460" watchObservedRunningTime="2026-06-10 01:19:30.824295517 +0000 UTC m=+2655.069754599" Jun 10 01:19:31.504639 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:31.504598 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-np6lm_2b52f7c3-f3e8-4f8e-8e72-652281c1f826/global-pull-secret-syncer/0.log" Jun 10 01:19:31.558420 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:31.558389 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6pcw4_44be8050-f6c2-4a23-8515-1d9d33b45109/konnectivity-agent/0.log" Jun 10 01:19:31.694251 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:31.694214 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-158.ec2.internal_22450486f5446dc8ab729a99a08f76a6/haproxy/0.log" Jun 10 01:19:36.923459 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:36.922837 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86f8897ccc-jrlq7_b694ab43-3281-41e8-87a8-2ffa9db00f83/authorino/0.log" Jun 10 01:19:37.175958 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:37.175865 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7ccj8_0ebdd4f0-aa99-421d-9e87-98af9339a899/manager/0.log" Jun 10 01:19:39.297757 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.297676 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/node-exporter/0.log" Jun 10 01:19:39.333916 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.333886 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/kube-rbac-proxy/0.log" Jun 10 01:19:39.355837 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.355807 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z8gwp_aa8e0597-98d4-4f37-8e00-3815d57912d2/init-textfile/0.log" Jun 10 01:19:39.493395 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.493367 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/prometheus/0.log" Jun 10 01:19:39.522393 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.522366 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/config-reloader/0.log" Jun 10 01:19:39.553120 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.553094 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/thanos-sidecar/0.log" Jun 10 01:19:39.585603 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.585574 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/kube-rbac-proxy-web/0.log" Jun 10 01:19:39.610302 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.610271 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/kube-rbac-proxy/0.log" Jun 10 01:19:39.633246 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.633220 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/kube-rbac-proxy-thanos/0.log" Jun 10 01:19:39.656066 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.656041 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e8972d2-b3dc-4853-8aca-83c0f8eb196b/init-config-reloader/0.log" Jun 10 01:19:39.794997 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.794947 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/telemeter-client/0.log" Jun 10 01:19:39.816151 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.816065 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/reload/0.log" Jun 10 01:19:39.840677 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:39.840635 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b98b58c44-x9gft_343a3496-d351-4570-ac74-df59347741ff/kube-rbac-proxy/0.log" Jun 10 01:19:43.724202 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.724157 2521 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l"] Jun 10 01:19:43.732689 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.732656 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.736688 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.736635 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l"] Jun 10 01:19:43.770195 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.770161 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-lib-modules\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.770370 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.770227 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-sys\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.770370 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.770278 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-podres\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.770370 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.770302 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b6x8\" (UniqueName: \"kubernetes.io/projected/d0ed30c7-436e-42fe-9700-06d2ab339564-kube-api-access-9b6x8\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.770370 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.770344 2521 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-proc\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871040 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.870995 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b6x8\" (UniqueName: \"kubernetes.io/projected/d0ed30c7-436e-42fe-9700-06d2ab339564-kube-api-access-9b6x8\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871403 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871114 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-proc\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871403 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871352 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-lib-modules\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871560 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871397 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-proc\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871560 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871147 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-lib-modules\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871560 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871542 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-sys\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871678 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871637 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-sys\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871719 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871698 2521 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-podres\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.871834 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.871813 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0ed30c7-436e-42fe-9700-06d2ab339564-podres\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:43.880677 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:43.879792 2521 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b6x8\" (UniqueName: \"kubernetes.io/projected/d0ed30c7-436e-42fe-9700-06d2ab339564-kube-api-access-9b6x8\") pod \"perf-node-gather-daemonset-fvb8l\" (UID: \"d0ed30c7-436e-42fe-9700-06d2ab339564\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:44.054038 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.054005 2521 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:44.255297 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.255230 2521 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l"] Jun 10 01:19:44.621797 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.621726 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cv84d_c7c279e6-c0d0-468b-9940-45b25b385669/dns/0.log" Jun 10 01:19:44.640861 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.640837 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cv84d_c7c279e6-c0d0-468b-9940-45b25b385669/kube-rbac-proxy/0.log" Jun 10 01:19:44.726800 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.726773 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ck45j_039c063d-1d7c-467b-8ef5-9e468078a18c/dns-node-resolver/0.log" Jun 10 01:19:44.912147 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.911924 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" event={"ID":"d0ed30c7-436e-42fe-9700-06d2ab339564","Type":"ContainerStarted","Data":"d414fb87dc2776ea3fd2907b8b171895b779732cf46b12c257188584a951bddf"} Jun 10 01:19:44.912147 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.911986 2521 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" event={"ID":"d0ed30c7-436e-42fe-9700-06d2ab339564","Type":"ContainerStarted","Data":"7866a4de181a24e9c0295d2b50cad5eb87063e384ee0ed42ba7fac9b2bcf6962"} Jun 10 01:19:44.912493 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.912472 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:44.927963 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:44.927909 2521 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" podStartSLOduration=1.927892836 podStartE2EDuration="1.927892836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:44.927577459 +0000 UTC m=+2669.173036539" watchObservedRunningTime="2026-06-10 01:19:44.927892836 +0000 UTC m=+2669.173351914" Jun 10 01:19:45.325278 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:45.325248 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9zpt_b569054a-1cb2-46cb-bcc6-99f6ff515e79/node-ca/0.log" Jun 10 01:19:46.490208 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:46.490166 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-4gt7c_051aaa2a-aafc-45f4-8338-d504dd128cad/kube-auth-proxy/0.log" Jun 10 01:19:47.454739 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:47.454710 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkzjd_aa75d238-2f3d-43b8-9787-7c2b884152a0/serve-healthcheck-canary/0.log" Jun 10 01:19:48.133190 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:48.133158 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwkhl_09504e20-8ab9-4e8f-9440-ed7d30f8474e/kube-rbac-proxy/0.log" Jun 10 01:19:48.154306 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:48.154276 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwkhl_09504e20-8ab9-4e8f-9440-ed7d30f8474e/exporter/0.log" Jun 10 01:19:48.174355 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:48.174323 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwkhl_09504e20-8ab9-4e8f-9440-ed7d30f8474e/extractor/0.log" Jun 10 01:19:50.661051 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:50.661020 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684220-6vd92_564d9449-9436-465e-85f7-117e59345aa2/cleanup/0.log" Jun 10 01:19:50.686818 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:50.686791 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684235-n28m7_6ec30f35-6163-4bd4-b66b-1a358213de1a/cleanup/0.log" Jun 10 01:19:50.929669 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:50.929595 2521 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-fvb8l" Jun 10 01:19:51.073105 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:51.073072 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-j8k6r_3923f78f-074b-4802-bf4d-d54f2cb0c3c3/manager/0.log" Jun 10 01:19:51.088613 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:51.088578 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-j8k6r_3923f78f-074b-4802-bf4d-d54f2cb0c3c3/copy-manifests/0.log" Jun 10 01:19:51.161607 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:51.161577 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-8ksqw_816b534f-99f0-4dec-b146-1f3b2f3f8ef7/postgres/0.log" Jun 10 01:19:52.801722 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:52.801662 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cc5ccc596-gx9np_fafc349f-f284-427f-b634-85baec288253/manager/0.log" Jun 10 01:19:57.181703 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:57.181671 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-4gt7c_051aaa2a-aafc-45f4-8338-d504dd128cad/kube-auth-proxy/0.log" Jun 10 01:19:58.727858 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:58.727830 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-4gt7c_051aaa2a-aafc-45f4-8338-d504dd128cad/kube-auth-proxy/0.log" Jun 10 01:19:59.686908 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:19:59.686883 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5dt5z_de1d8fed-c6e7-46bf-aa8b-3e60efc492d8/kube-multus/0.log" Jun 10 01:20:00.029076 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.028985 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/kube-multus-additional-cni-plugins/0.log" Jun 10 01:20:00.048869 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.048836 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/egress-router-binary-copy/0.log" Jun 10 01:20:00.067358 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.067336 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/cni-plugins/0.log" Jun 10 01:20:00.086153 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.086129 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/bond-cni-plugin/0.log" Jun 10 01:20:00.106001 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.105974 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/routeoverride-cni/0.log" Jun 10 01:20:00.125290 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.125264 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/whereabouts-cni-bincopy/0.log" Jun 10 01:20:00.144303 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.144204 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vrkkw_18800945-fb59-462f-8b55-11e825d11608/whereabouts-cni/0.log" Jun 10 01:20:00.290464 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.290366 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xbhcm_e204723b-797e-42f4-beb4-2dd1f95805c8/network-metrics-daemon/0.log" Jun 10 01:20:00.313919 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.313894 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xbhcm_e204723b-797e-42f4-beb4-2dd1f95805c8/kube-rbac-proxy/0.log" Jun 10 01:20:00.698896 ip-10-0-140-158 kubenswrapper[2521]: I0610 01:20:00.698790 2521 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-4gt7c_051aaa2a-aafc-45f4-8338-d504dd128cad/kube-auth-proxy/0.log"