Jun 11 18:36:34.936931 ip-10-0-140-119 systemd[1]: Starting Kubernetes Kubelet... Jun 11 18:36:35.291772 ip-10-0-140-119 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:35.291772 ip-10-0-140-119 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 18:36:35.291772 ip-10-0-140-119 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:35.291772 ip-10-0-140-119 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 18:36:35.291772 ip-10-0-140-119 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:35.292901 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.292604 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 18:36:35.298977 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298961 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.298977 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298975 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.298977 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298978 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298982 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298986 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298988 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298991 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298994 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298996 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.298999 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299003 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299006 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299008 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299011 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299013 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299016 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299018 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299021 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299025 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299027 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299030 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299033 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.299079 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299035 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299039 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299043 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299046 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299049 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299052 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299054 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299057 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299060 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299062 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299065 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299067 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299070 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299074 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299078 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299081 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299084 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299088 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299091 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.299566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299094 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299097 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299100 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299102 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299105 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299108 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299111 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299113 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299116 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299119 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299122 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299125 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299128 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299130 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299133 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299135 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299138 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299140 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299143 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.300043 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299145 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299148 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299151 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299153 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299156 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299158 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299161 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299163 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299167 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299169 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299172 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299174 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299177 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299180 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299183 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299186 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299188 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299191 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299193 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299196 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.300536 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299199 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299202 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299205 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299207 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299210 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299212 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299214 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299219 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299226 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299229 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299231 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299234 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299236 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299239 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299241 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299244 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299246 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299249 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.301039 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299943 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299952 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299955 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299958 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299960 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299963 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299966 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299969 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299971 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299975 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299977 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299980 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299982 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299985 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299988 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299990 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299993 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299995 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.299997 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300001 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.301541 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300005 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300008 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300011 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300013 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300016 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300019 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300021 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300023 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300026 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300028 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300031 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300033 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300036 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300039 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300042 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300046 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300050 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300053 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300056 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300059 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.302055 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300062 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300065 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300068 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300070 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300073 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300075 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300078 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300081 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300084 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300086 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300089 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300091 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300094 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300096 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300099 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300102 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300104 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300107 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300109 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.302581 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300111 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300114 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300116 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300119 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300121 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300124 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300127 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300130 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300132 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300135 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300137 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300140 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300142 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300145 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300148 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300150 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300153 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300155 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300158 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300160 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.303068 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300163 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300166 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300169 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300171 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300174 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300176 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300179 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300181 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300184 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300186 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300189 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300191 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300194 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300196 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300198 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300201 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300204 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300206 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300209 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300212 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.303566 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300552 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300557 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300560 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300563 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300565 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300568 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300571 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300574 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300577 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300579 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300582 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300584 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300587 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300590 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300592 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300595 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300597 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300600 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300602 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300605 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.304065 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300607 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300610 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300612 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300615 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300617 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300620 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300626 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300629 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300633 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300637 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300640 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300658 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300661 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300664 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300666 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300669 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300672 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300675 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300679 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.304551 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300683 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300686 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300689 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300692 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300694 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300697 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300700 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300703 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300706 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300708 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300711 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300714 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300717 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300719 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300722 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300725 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300727 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300730 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300732 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300737 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.305037 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300739 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300744 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300747 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300749 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300752 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300757 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300760 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300763 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300765 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300768 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300770 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300773 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300775 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300778 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300781 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300783 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300785 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300788 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300790 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300793 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.305544 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300795 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300798 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300800 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300802 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300805 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300808 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300810 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300813 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300815 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300818 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300820 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300825 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300827 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300831 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300834 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300837 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300839 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300842 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300844 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.306052 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.300847 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300913 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300920 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300926 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300932 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300939 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300944 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300950 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300956 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300959 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300962 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300966 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300969 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300973 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300976 2567 flags.go:64] FLAG: --cgroup-root="" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300979 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300981 2567 flags.go:64] FLAG: --client-ca-file="" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300984 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300987 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300992 2567 flags.go:64] FLAG: --cluster-domain="" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300995 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.300998 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301001 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301005 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 18:36:35.306511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301010 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301013 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301017 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301020 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301024 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301026 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301029 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301032 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301035 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301040 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301043 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301046 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301049 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301052 2567 flags.go:64] FLAG: --enable-server="true" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301055 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301059 2567 flags.go:64] FLAG: --event-burst="100" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301062 2567 flags.go:64] FLAG: --event-qps="50" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301066 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301069 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301071 2567 flags.go:64] FLAG: --eviction-hard="" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301075 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301078 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301080 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301084 2567 flags.go:64] FLAG: --eviction-soft="" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301087 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 18:36:35.307102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301089 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301092 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301095 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301098 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301101 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301104 2567 flags.go:64] FLAG: --feature-gates="" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301107 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301111 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301114 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301122 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301125 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301128 2567 flags.go:64] FLAG: --help="false" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301130 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301133 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301136 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301139 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301143 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301146 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301149 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301151 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301155 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301157 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301160 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301163 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 18:36:35.307850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301167 2567 flags.go:64] FLAG: --kube-reserved="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301170 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301173 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301176 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301179 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301182 2567 flags.go:64] FLAG: --lock-file="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301184 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301187 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301190 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301195 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301198 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301200 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301203 2567 flags.go:64] FLAG: --logging-format="text" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301206 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301209 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301212 2567 flags.go:64] FLAG: --manifest-url="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301215 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301227 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301230 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301234 2567 flags.go:64] FLAG: --max-pods="110" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301238 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301241 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301243 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301247 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301249 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 18:36:35.308772 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301252 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301255 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301262 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301265 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301268 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301271 2567 flags.go:64] FLAG: --pod-cidr="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301274 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301280 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301283 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301286 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301289 2567 flags.go:64] FLAG: --port="10250" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301292 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301295 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa27200e0f910b98" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301298 2567 flags.go:64] FLAG: --qos-reserved="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301301 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301304 2567 flags.go:64] FLAG: --register-node="true" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301307 2567 flags.go:64] FLAG: --register-with-taints="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301311 2567 flags.go:64] FLAG: --registry-burst="10" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301313 2567 flags.go:64] FLAG: --registry-qps="5" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301316 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301319 2567 flags.go:64] FLAG: --reserved-memory="" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301322 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301325 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301328 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301332 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 18:36:35.309798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301335 2567 flags.go:64] FLAG: --runonce="false" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301338 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301341 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301344 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301347 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301350 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301353 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301356 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301359 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301361 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301364 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301367 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301370 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301373 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301376 2567 flags.go:64] FLAG: --system-cgroups="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301379 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301384 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301387 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301390 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301395 2567 flags.go:64] FLAG: --tls-min-version="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301397 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301400 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301403 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301405 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301408 2567 flags.go:64] FLAG: --v="2" Jun 11 18:36:35.310828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301412 2567 flags.go:64] FLAG: --version="false" Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301416 2567 flags.go:64] FLAG: --vmodule="" Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301420 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.301423 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301547 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301553 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301558 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301561 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301564 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301567 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301570 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301572 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301575 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301577 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301580 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301582 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301585 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301587 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301590 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301592 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.311895 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301595 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301597 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301600 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301602 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301605 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301608 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301611 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301613 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301615 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301618 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301620 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301623 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301625 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301628 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301630 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301632 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301636 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301641 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301659 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301662 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.312765 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301665 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301668 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301671 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301674 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301676 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301679 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301683 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301686 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301689 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301692 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301695 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301698 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301701 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301703 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301706 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301709 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301712 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301715 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301718 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.313716 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301720 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301723 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301725 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301728 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301730 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301733 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301735 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301738 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301741 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301743 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301747 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301752 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301754 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301757 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301759 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301762 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301765 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301767 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301770 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301772 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.314302 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301775 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301777 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301780 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301783 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301785 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301788 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301790 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301793 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301795 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301798 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301801 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301803 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301806 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301808 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301811 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301813 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301816 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301818 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301821 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.314959 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301824 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301826 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301829 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301832 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.301836 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.302565 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.312345 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.312366 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.312401 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.312415 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312504 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312514 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312519 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312524 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.315769 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312529 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312533 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312538 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312542 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312547 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312551 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312555 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312560 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312564 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312568 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312573 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312577 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312582 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312586 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312590 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312595 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312601 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312607 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312612 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.316277 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312617 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312624 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312629 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312634 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312640 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312661 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312666 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312671 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312675 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312680 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312684 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312688 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312692 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312696 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312701 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312705 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312709 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312713 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312718 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.316808 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312722 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312725 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312732 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312739 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312744 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312748 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312752 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312757 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312761 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312766 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312770 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312774 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312778 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312782 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312786 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312790 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312794 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312799 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312803 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.317371 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312808 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312813 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312817 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312821 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312826 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312830 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312834 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312838 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312842 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312846 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312851 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312855 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312859 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312864 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312868 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312872 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312877 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312881 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312894 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312899 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.317902 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312903 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312907 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312911 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312915 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312920 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312924 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312929 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312933 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312937 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312942 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312947 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312951 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312956 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312960 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312964 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312968 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312973 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.318446 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.312977 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.312985 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313186 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313196 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313201 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313205 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313209 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313214 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313225 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313230 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313234 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313238 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313242 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313247 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:35.318893 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313261 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313268 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313273 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313278 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313283 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313288 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313293 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313297 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313301 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313307 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313313 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313319 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313323 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313327 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313332 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313336 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313340 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313344 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313349 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313353 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:35.319316 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313357 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313361 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313365 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313369 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313373 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313377 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313381 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313386 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313390 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313394 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313398 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313402 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313408 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313418 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313422 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313426 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313431 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313435 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313439 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313443 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:35.319836 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313447 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313452 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313457 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313461 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313465 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313470 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313475 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313479 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313483 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313487 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313491 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313496 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313500 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313504 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313508 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313512 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313517 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313521 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313525 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:35.320376 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313529 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313533 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313538 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313542 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313546 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313551 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313555 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313560 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313565 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313569 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313573 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313577 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313581 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313586 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313590 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313594 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313598 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313605 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313611 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:35.321295 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313616 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313620 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313625 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313629 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313633 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313637 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313655 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313660 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:35.313664 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.313672 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.313837 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.316823 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.318369 2567 server.go:1019] "Starting client certificate rotation" Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.318470 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:36:35.321912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.318500 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:36:35.322263 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.321084 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:36:35.324029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.324005 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:36:35.334458 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.334440 2567 log.go:25] "Validated CRI v1 runtime API" Jun 11 18:36:35.338204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.338189 2567 log.go:25] "Validated CRI v1 image API" Jun 11 18:36:35.339111 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.339096 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 18:36:35.341475 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.341451 2567 fs.go:135] Filesystem UUIDs: map[22913fbd-057f-4947-9ee7-379afd765682:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dee0124a-f028-4c06-ab78-1a706417ecf1:/dev/nvme0n1p3] Jun 11 18:36:35.341555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.341474 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 18:36:35.348027 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.347918 2567 manager.go:216] Machine: {Timestamp:2026-06-11 18:36:35.346765023 +0000 UTC m=+0.299567428 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101016 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df29df3a4ffe565228fd2f36906aa SystemUUID:ec2df29d-f3a4-ffe5-6522-8fd2f36906aa BootID:95599a78-1971-4337-b9f3-4d3412ba1698 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:5e:b4:5c:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:5e:b4:5c:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:5c:20:84:d6:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 18:36:35.348027 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.348019 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 18:36:35.348149 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.348132 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 18:36:35.351213 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.351188 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 18:36:35.351340 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.351217 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 18:36:35.352084 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.352068 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:36:35.352560 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.352547 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 18:36:35.352597 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.352565 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 18:36:35.352597 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.352573 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:36:35.353121 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.353110 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:36:35.354824 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.354814 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 18:36:35.358779 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.358768 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:36:35.359050 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359040 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 18:36:35.359079 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359075 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 11 18:36:35.359111 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359093 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 18:36:35.359111 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359104 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 18:36:35.359173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359114 2567 kubelet.go:398] "Adding apiserver pod source" Jun 11 18:36:35.359173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359122 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 18:36:35.359486 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359474 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:36:35.359525 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.359491 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:36:35.361468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.361445 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 18:36:35.363227 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363210 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 18:36:35.363293 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363243 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 18:36:35.363406 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363396 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 18:36:35.363439 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363415 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 18:36:35.363439 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363427 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 18:36:35.363439 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363437 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 18:36:35.363523 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363448 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 18:36:35.363523 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363456 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 18:36:35.363767 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363758 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 18:36:35.363805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363769 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 18:36:35.363805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363776 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 18:36:35.363805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363782 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 18:36:35.363805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363796 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 18:36:35.363805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.363804 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 18:36:35.365247 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.365234 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 18:36:35.365247 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.365245 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 18:36:35.366639 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.366614 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 18:36:35.367007 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.366982 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 18:36:35.367007 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.366985 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 18:36:35.368409 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.368397 2567 server.go:1268] "Started kubelet" Jun 11 18:36:35.368482 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.368456 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 18:36:35.368590 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.368540 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 18:36:35.368637 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.368608 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 18:36:35.370289 ip-10-0-140-119 systemd[1]: Started Kubernetes Kubelet. Jun 11 18:36:35.370457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.370436 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgkw8" Jun 11 18:36:35.370508 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.370465 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 18:36:35.371942 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.371819 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 11 18:36:35.375913 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.375895 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 18:36:35.376077 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376065 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 18:36:35.376077 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376072 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 18:36:35.376251 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.376224 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.376734 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376720 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 18:36:35.376808 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376780 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 18:36:35.376808 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376794 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 18:36:35.376915 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376893 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 11 18:36:35.376915 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.376904 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 11 18:36:35.377043 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377017 2567 factory.go:55] Registering systemd factory Jun 11 18:36:35.377043 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377043 2567 factory.go:223] Registration of the systemd container factory successfully Jun 11 18:36:35.377200 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377105 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgkw8" Jun 11 18:36:35.377270 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377251 2567 factory.go:153] Registering CRI-O factory Jun 11 18:36:35.377270 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377264 2567 factory.go:223] Registration of the crio container factory successfully Jun 11 18:36:35.377407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377350 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 18:36:35.377407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377371 2567 factory.go:103] Registering Raw factory Jun 11 18:36:35.377407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377385 2567 manager.go:1196] Started watching for new ooms in manager Jun 11 18:36:35.377920 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.377908 2567 manager.go:349] Starting recovery of all containers Jun 11 18:36:35.382746 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.382706 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 18:36:35.392625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.392601 2567 manager.go:354] Recovery completed Jun 11 18:36:35.392768 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.392722 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-119.ec2.internal\" not found" node="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.396829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.396816 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.398912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.398899 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.398971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.398925 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.398971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.398935 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.399411 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.399399 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 18:36:35.399411 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.399409 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 18:36:35.399491 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.399414 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.399491 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.399426 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:36:35.400267 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.400251 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.400335 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.400276 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.400335 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.400286 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.401302 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.401287 2567 policy_none.go:49] "None policy: Start" Jun 11 18:36:35.401377 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.401305 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 18:36:35.401377 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.401328 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 18:36:35.403139 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.403126 2567 policy_none.go:47] "Start" Jun 11 18:36:35.439216 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439202 2567 manager.go:337] "Starting Device Plugin manager" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.439278 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439302 2567 server.go:87] "Starting device plugin registration server" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439561 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439576 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439679 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439752 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.439758 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.440343 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.440385 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.450110 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.451314 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.451345 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.451374 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.451403 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 18:36:35.463173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.454021 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:35.540508 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.540484 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.541707 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.541688 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.541828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.541725 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.541828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.541738 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.541828 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.541761 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.552333 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.552313 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal"] Jun 11 18:36:35.552395 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.552370 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.553868 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.553846 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.553960 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.553877 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.553960 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.553891 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.553960 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.553953 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.554063 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.553971 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-119.ec2.internal\": node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.556116 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556103 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.556239 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.556283 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556258 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.556865 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556851 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.556948 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556873 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.556948 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556874 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.556948 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556904 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.556948 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556914 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.557076 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.556888 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.559112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.559095 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.559198 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.559126 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.560151 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.560137 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.560227 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.560163 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.560227 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.560190 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.572964 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.572948 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.578147 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.578129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.578199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.578156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.578199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.578173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e45fe30cb4777b4725763e55e81d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-119.ec2.internal\" (UID: \"08e45fe30cb4777b4725763e55e81d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.595297 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.595278 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-119.ec2.internal\" not found" node="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.600903 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.600884 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-119.ec2.internal\" not found" node="ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.673623 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.673601 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.678796 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.678859 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e45fe30cb4777b4725763e55e81d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-119.ec2.internal\" (UID: \"08e45fe30cb4777b4725763e55e81d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.678859 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.678859 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.678982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e45fe30cb4777b4725763e55e81d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-119.ec2.internal\" (UID: \"08e45fe30cb4777b4725763e55e81d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.678982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.678896 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/894fe180e31fefee1f1a3611f2e490a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal\" (UID: \"894fe180e31fefee1f1a3611f2e490a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.773984 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.773954 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.874697 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.874619 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:35.898030 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.898010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.905735 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:35.905715 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:35.975153 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:35.975104 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:36.075658 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.075610 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:36.176181 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.176108 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:36.276569 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.276525 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-119.ec2.internal\" not found" Jun 11 18:36:36.317913 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.317885 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 18:36:36.318427 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.318032 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:36:36.339346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.339324 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:36.360297 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.360272 2567 apiserver.go:52] "Watching apiserver" Jun 11 18:36:36.369818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.369793 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 18:36:36.370957 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.370934 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8jmrj","openshift-image-registry/node-ca-twpkn","openshift-multus/multus-additional-cni-plugins-cld4v","openshift-multus/network-metrics-daemon-qvzd5","openshift-network-operator/iptables-alerter-nldxm","openshift-ovn-kubernetes/ovnkube-node-67cvn","kube-system/konnectivity-agent-cz4xx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw","openshift-dns/node-resolver-cz27w","openshift-multus/multus-lsxm4","openshift-network-diagnostics/network-check-target-hv88l","kube-system/global-pull-secret-syncer-x96t8"] Jun 11 18:36:36.373508 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.373488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.375728 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.375708 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7rwn4\"" Jun 11 18:36:36.375888 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.375871 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.375994 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.375977 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.376172 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.376156 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 18:36:36.376268 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.376187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.376327 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.376282 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" Jun 11 18:36:36.378395 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.378376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.378764 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.378746 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.378853 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.378779 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 18:36:36.378913 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.378886 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p8pjz\"" Jun 11 18:36:36.379013 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.378998 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.380452 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.380437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.380531 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.380485 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:36.380698 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.380682 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 18:36:36.380784 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.380711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.380784 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.380713 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 18:36:36.380913 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.380800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 18:36:36.381084 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7kdr\"" Jun 11 18:36:36.381848 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.381907 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.381907 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqfr\" (UniqueName: \"kubernetes.io/projected/6de2aab9-530b-457e-b4d0-580da9909cfc-kube-api-access-ngqfr\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.381982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-modprobe-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.381982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysconfig\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.381982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-kubernetes\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.381991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-conf\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-lib-modules\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94j5\" (UniqueName: \"kubernetes.io/projected/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-kube-api-access-p94j5\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-system-cni-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-systemd\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-var-lib-kubelet\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-host\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-tuned\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90687bce-fed4-427e-906d-010c50f2e0b4-serviceca\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-os-release\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382248 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-sys\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjsmq\" (UniqueName: \"kubernetes.io/projected/90687bce-fed4-427e-906d-010c50f2e0b4-kube-api-access-vjsmq\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-run\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-tmp\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90687bce-fed4-427e-906d-010c50f2e0b4-host\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-cnibin\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.382603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.382581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.384549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384528 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 18:31:35 +0000 UTC" deadline="2027-11-12 19:50:40.544976482 +0000 UTC" Jun 11 18:36:36.384549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384549 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12457h14m4.1604302s" Jun 11 18:36:36.384886 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384861 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.384987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384905 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 18:36:36.384987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384919 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.385095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.384990 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.385095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.385035 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckvpn\"" Jun 11 18:36:36.387203 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.387181 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.387515 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.387498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.388130 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.388032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.388561 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.388715 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.389388 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.389438 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.389736 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 18:36:36.390382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.389884 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mp6bv\"" Jun 11 18:36:36.391404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.390501 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 18:36:36.391404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.391094 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:36.391404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.391241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 18:36:36.391404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.391288 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" Jun 11 18:36:36.391853 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.391833 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fq8wl\"" Jun 11 18:36:36.391931 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.391897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.394206 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.394187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.394312 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.394292 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 18:36:36.394370 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.394314 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.394523 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.394506 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.394625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.394605 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x9g2h\"" Jun 11 18:36:36.396493 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.396478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.396760 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.396744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9hmdm\"" Jun 11 18:36:36.396857 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.396838 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.396951 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.396936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.399144 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.398952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:36.399144 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.399025 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:36.399301 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.399286 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:36.399398 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.399384 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 18:36:36.399629 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.399612 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zl6j2\"" Jun 11 18:36:36.401880 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.401862 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal"] Jun 11 18:36:36.401951 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.401892 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal"] Jun 11 18:36:36.401991 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.401958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.402023 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.401999 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:36.417341 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.417321 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckct7" Jun 11 18:36:36.427705 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.427663 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckct7" Jun 11 18:36:36.478323 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.478296 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 18:36:36.483850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.483823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-slash\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.483981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.483904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-systemd\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.483981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.483947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.483981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.483981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-log-socket\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484165 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484165 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-systemd\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.484278 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484278 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjsmq\" (UniqueName: \"kubernetes.io/projected/90687bce-fed4-427e-906d-010c50f2e0b4-kube-api-access-vjsmq\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.484278 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-systemd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484423 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-os-release\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.484423 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-cni-binary-copy\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.484423 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-etc-kubernetes\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.484423 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-registration-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.484599 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-etc-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484599 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-bin\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484599 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-script-lib\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.484599 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-system-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.484599 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-sys-fs\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2552f7c5-7246-444e-91d9-0e05ee06c6c6-iptables-alerter-script\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-var-lib-kubelet\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484774 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-host\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.484851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-tuned\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.485123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-host\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.485123 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.484919 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894fe180e31fefee1f1a3611f2e490a8.slice/crio-c8e18f245a005cba8d7bb88b8dff5e6d345a678f4516775a6c96b497130c5422 WatchSource:0}: Error finding container c8e18f245a005cba8d7bb88b8dff5e6d345a678f4516775a6c96b497130c5422: Status 404 returned error can't find the container with id c8e18f245a005cba8d7bb88b8dff5e6d345a678f4516775a6c96b497130c5422 Jun 11 18:36:36.485123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.485123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.484986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-var-lib-kubelet\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.485123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90687bce-fed4-427e-906d-010c50f2e0b4-serviceca\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.485361 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-os-release\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.485361 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485229 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 18:36:36.485572 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/428e54f8-d8db-4e06-8387-44a80d9e237d-konnectivity-ca\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.485572 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-sys\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.485572 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-os-release\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.485936 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90687bce-fed4-427e-906d-010c50f2e0b4-serviceca\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.486011 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-sys\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486011 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.485984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7wx\" (UniqueName: \"kubernetes.io/projected/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kube-api-access-cw7wx\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.486104 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-node-log\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.486104 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s452d\" (UniqueName: \"kubernetes.io/projected/e7f407b2-cfd8-4565-af28-70616f6e1b95-kube-api-access-s452d\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.486104 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:36.486104 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-kubelet-config\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-run\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-tmp\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90687bce-fed4-427e-906d-010c50f2e0b4-host\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-systemd-units\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-ovn\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.486264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-modprobe-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-kubernetes\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-lib-modules\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94j5\" (UniqueName: \"kubernetes.io/projected/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-kube-api-access-p94j5\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-system-cni-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-kubelet\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-var-lib-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-config\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-dbus\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-run\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f407b2-cfd8-4565-af28-70616f6e1b95-tmp-dir\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486583 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-modprobe-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-bin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.486716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-multus-certs\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87w2\" (UniqueName: \"kubernetes.io/projected/2552f7c5-7246-444e-91d9-0e05ee06c6c6-kube-api-access-r87w2\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-d\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-hostroot\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-kubernetes\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-conf-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87jb7\" (UniqueName: \"kubernetes.io/projected/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-kube-api-access-87jb7\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.486846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-system-cni-dir\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-lib-modules\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90687bce-fed4-427e-906d-010c50f2e0b4-host\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9834d578-89cf-4069-8b1a-d3c05604129a-ovn-node-metrics-cert\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7f407b2-cfd8-4565-af28-70616f6e1b95-hosts-file\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-multus\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/428e54f8-d8db-4e06-8387-44a80d9e237d-agent-certs\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.487474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-netd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5scz\" (UniqueName: \"kubernetes.io/projected/9834d578-89cf-4069-8b1a-d3c05604129a-kube-api-access-m5scz\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-cnibin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-socket-dir-parent\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-socket-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-device-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2552f7c5-7246-444e-91d9-0e05ee06c6c6-host-slash\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-netns\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-tuned\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-cnibin\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6de2aab9-530b-457e-b4d0-580da9909cfc-cnibin\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqfr\" (UniqueName: \"kubernetes.io/projected/6de2aab9-530b-457e-b4d0-580da9909cfc-kube-api-access-ngqfr\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.487958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.488187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-kubelet\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-env-overrides\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysconfig\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-conf\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-k8s-cni-cncf-io\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-netns\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-multus-daemon-config\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488295 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6de2aab9-530b-457e-b4d0-580da9909cfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmxrl\" (UniqueName: \"kubernetes.io/projected/951b10b5-5d28-4b30-b803-cec503fae978-kube-api-access-gmxrl\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488379 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysconfig\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488409 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-etc-sysctl-conf\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.489095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.488443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.489629 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.489193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-tmp\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.490535 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.490506 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:36:36.492201 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.492174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjsmq\" (UniqueName: \"kubernetes.io/projected/90687bce-fed4-427e-906d-010c50f2e0b4-kube-api-access-vjsmq\") pod \"node-ca-twpkn\" (UID: \"90687bce-fed4-427e-906d-010c50f2e0b4\") " pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.497492 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.497470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94j5\" (UniqueName: \"kubernetes.io/projected/9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6-kube-api-access-p94j5\") pod \"tuned-8jmrj\" (UID: \"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.498737 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.498717 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqfr\" (UniqueName: \"kubernetes.io/projected/6de2aab9-530b-457e-b4d0-580da9909cfc-kube-api-access-ngqfr\") pod \"multus-additional-cni-plugins-cld4v\" (UID: \"6de2aab9-530b-457e-b4d0-580da9909cfc\") " pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.588813 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-script-lib\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.588813 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-system-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-sys-fs\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2552f7c5-7246-444e-91d9-0e05ee06c6c6-iptables-alerter-script\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/428e54f8-d8db-4e06-8387-44a80d9e237d-konnectivity-ca\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7wx\" (UniqueName: \"kubernetes.io/projected/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kube-api-access-cw7wx\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-sys-fs\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-node-log\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588963 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-node-log\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.588968 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.588961 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-system-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.589042 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s452d\" (UniqueName: \"kubernetes.io/projected/e7f407b2-cfd8-4565-af28-70616f6e1b95-kube-api-access-s452d\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-kubelet-config\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-systemd-units\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.589192 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.08914918 +0000 UTC m=+2.041951567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-systemd-units\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-kubelet-config\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-ovn\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-ovn\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-kubelet\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-kubelet\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-var-lib-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-config\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-var-lib-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-dbus\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.589468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-script-lib\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f407b2-cfd8-4565-af28-70616f6e1b95-tmp-dir\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7f407b2-cfd8-4565-af28-70616f6e1b95-tmp-dir\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-bin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/428e54f8-d8db-4e06-8387-44a80d9e237d-konnectivity-ca\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24977f59-bbbd-46e6-8455-a65836976c6f-dbus\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.589526 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-multus-certs\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.589833 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.089813587 +0000 UTC m=+2.042615976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-multus-certs\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-bin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-ovnkube-config\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87w2\" (UniqueName: \"kubernetes.io/projected/2552f7c5-7246-444e-91d9-0e05ee06c6c6-kube-api-access-r87w2\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-hostroot\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-conf-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87jb7\" (UniqueName: \"kubernetes.io/projected/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-kube-api-access-87jb7\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.590012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9834d578-89cf-4069-8b1a-d3c05604129a-ovn-node-metrics-cert\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.589969 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-hostroot\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7f407b2-cfd8-4565-af28-70616f6e1b95-hosts-file\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-conf-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-multus\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7f407b2-cfd8-4565-af28-70616f6e1b95-hosts-file\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/428e54f8-d8db-4e06-8387-44a80d9e237d-agent-certs\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590081 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-var-lib-cni-multus\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-netd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5scz\" (UniqueName: \"kubernetes.io/projected/9834d578-89cf-4069-8b1a-d3c05604129a-kube-api-access-m5scz\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-cnibin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-netd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2552f7c5-7246-444e-91d9-0e05ee06c6c6-iptables-alerter-script\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-socket-dir-parent\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-cnibin\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-socket-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-socket-dir-parent\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-device-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.590879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2552f7c5-7246-444e-91d9-0e05ee06c6c6-host-slash\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-device-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-netns\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2552f7c5-7246-444e-91d9-0e05ee06c6c6-host-slash\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-socket-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-netns\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-kubelet\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590399 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-env-overrides\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-k8s-cni-cncf-io\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-multus-cni-dir\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-kubelet\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-netns\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-multus-daemon-config\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-k8s-cni-cncf-io\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.591549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmxrl\" (UniqueName: \"kubernetes.io/projected/951b10b5-5d28-4b30-b803-cec503fae978-kube-api-access-gmxrl\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-host-run-netns\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-slash\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590603 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-slash\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-log-socket\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-run-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590818 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-log-socket\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9834d578-89cf-4069-8b1a-d3c05604129a-env-overrides\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-systemd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-multus-daemon-config\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590931 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-os-release\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-run-systemd\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.590977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-cni-binary-copy\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-etc-kubernetes\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-registration-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-os-release\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-etc-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-bin\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-registration-dir\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-etc-openvswitch\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/951b10b5-5d28-4b30-b803-cec503fae978-etc-kubernetes\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9834d578-89cf-4069-8b1a-d3c05604129a-host-cni-bin\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.591321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/951b10b5-5d28-4b30-b803-cec503fae978-cni-binary-copy\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.592616 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.592537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9834d578-89cf-4069-8b1a-d3c05604129a-ovn-node-metrics-cert\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.592987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.592638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/428e54f8-d8db-4e06-8387-44a80d9e237d-agent-certs\") pod \"konnectivity-agent-cz4xx\" (UID: \"428e54f8-d8db-4e06-8387-44a80d9e237d\") " pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.595635 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.595616 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:36.595776 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.595637 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:36.595776 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.595664 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.595776 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:36.595719 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.095704173 +0000 UTC m=+2.048506546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.597837 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.597814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s452d\" (UniqueName: \"kubernetes.io/projected/e7f407b2-cfd8-4565-af28-70616f6e1b95-kube-api-access-s452d\") pod \"node-resolver-cz27w\" (UID: \"e7f407b2-cfd8-4565-af28-70616f6e1b95\") " pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.597935 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.597910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87w2\" (UniqueName: \"kubernetes.io/projected/2552f7c5-7246-444e-91d9-0e05ee06c6c6-kube-api-access-r87w2\") pod \"iptables-alerter-nldxm\" (UID: \"2552f7c5-7246-444e-91d9-0e05ee06c6c6\") " pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.598180 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.598160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7wx\" (UniqueName: \"kubernetes.io/projected/151fef3b-4514-4e0a-bcc6-ae7c18b3bd20-kube-api-access-cw7wx\") pod \"aws-ebs-csi-driver-node-9nkkw\" (UID: \"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.598590 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.598562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87jb7\" (UniqueName: \"kubernetes.io/projected/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-kube-api-access-87jb7\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:36.598876 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.598858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5scz\" (UniqueName: \"kubernetes.io/projected/9834d578-89cf-4069-8b1a-d3c05604129a-kube-api-access-m5scz\") pod \"ovnkube-node-67cvn\" (UID: \"9834d578-89cf-4069-8b1a-d3c05604129a\") " pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.598999 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.598983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmxrl\" (UniqueName: \"kubernetes.io/projected/951b10b5-5d28-4b30-b803-cec503fae978-kube-api-access-gmxrl\") pod \"multus-lsxm4\" (UID: \"951b10b5-5d28-4b30-b803-cec503fae978\") " pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.696706 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.696617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" Jun 11 18:36:36.706682 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.706638 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbcecc1_f08a_480b_bf0e_e3e39d3e92e6.slice/crio-0a774733383065d1ebdd4f58b81337c3e57048871c426889c5b0039152324b2c WatchSource:0}: Error finding container 0a774733383065d1ebdd4f58b81337c3e57048871c426889c5b0039152324b2c: Status 404 returned error can't find the container with id 0a774733383065d1ebdd4f58b81337c3e57048871c426889c5b0039152324b2c Jun 11 18:36:36.717579 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.717561 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twpkn" Jun 11 18:36:36.723463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.723450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cld4v" Jun 11 18:36:36.725684 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.725658 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90687bce_fed4_427e_906d_010c50f2e0b4.slice/crio-be7bdde9d5e6d077133452b1342819750bb8faae9449e8dda09d254b66b00b92 WatchSource:0}: Error finding container be7bdde9d5e6d077133452b1342819750bb8faae9449e8dda09d254b66b00b92: Status 404 returned error can't find the container with id be7bdde9d5e6d077133452b1342819750bb8faae9449e8dda09d254b66b00b92 Jun 11 18:36:36.732216 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.732197 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de2aab9_530b_457e_b4d0_580da9909cfc.slice/crio-d34b8c4e48cbd962b6857e96b12f285248ef4816067eceb2158d3fb5abe81c2c WatchSource:0}: Error finding container d34b8c4e48cbd962b6857e96b12f285248ef4816067eceb2158d3fb5abe81c2c: Status 404 returned error can't find the container with id d34b8c4e48cbd962b6857e96b12f285248ef4816067eceb2158d3fb5abe81c2c Jun 11 18:36:36.742285 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.742268 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nldxm" Jun 11 18:36:36.748232 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.748139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:36:36.753066 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.753046 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2552f7c5_7246_444e_91d9_0e05ee06c6c6.slice/crio-edb22b5679a130e03d5a5225f610924faccfba58c95ddaf5ff3db32f06de4069 WatchSource:0}: Error finding container edb22b5679a130e03d5a5225f610924faccfba58c95ddaf5ff3db32f06de4069: Status 404 returned error can't find the container with id edb22b5679a130e03d5a5225f610924faccfba58c95ddaf5ff3db32f06de4069 Jun 11 18:36:36.756401 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.756382 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9834d578_89cf_4069_8b1a_d3c05604129a.slice/crio-110e59c0b3133037319152ec7d3e3e74e358470ab514d712b428df2ad6ab3da5 WatchSource:0}: Error finding container 110e59c0b3133037319152ec7d3e3e74e358470ab514d712b428df2ad6ab3da5: Status 404 returned error can't find the container with id 110e59c0b3133037319152ec7d3e3e74e358470ab514d712b428df2ad6ab3da5 Jun 11 18:36:36.764933 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.764917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:36.773665 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.773628 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428e54f8_d8db_4e06_8387_44a80d9e237d.slice/crio-8217c6ca8d8943b887bab2cd6cdd0afebd87f99313dd476e167cd7591e82ba7c WatchSource:0}: Error finding container 8217c6ca8d8943b887bab2cd6cdd0afebd87f99313dd476e167cd7591e82ba7c: Status 404 returned error can't find the container with id 8217c6ca8d8943b887bab2cd6cdd0afebd87f99313dd476e167cd7591e82ba7c Jun 11 18:36:36.782166 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.782151 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" Jun 11 18:36:36.790058 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.790041 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151fef3b_4514_4e0a_bcc6_ae7c18b3bd20.slice/crio-81a3926b048fc21e1f4a43777ea5b347f0e12a76c140f772f42e90cb871e00b2 WatchSource:0}: Error finding container 81a3926b048fc21e1f4a43777ea5b347f0e12a76c140f772f42e90cb871e00b2: Status 404 returned error can't find the container with id 81a3926b048fc21e1f4a43777ea5b347f0e12a76c140f772f42e90cb871e00b2 Jun 11 18:36:36.794693 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.794678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cz27w" Jun 11 18:36:36.799662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.799630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsxm4" Jun 11 18:36:36.803171 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.803153 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f407b2_cfd8_4565_af28_70616f6e1b95.slice/crio-0a8ef8a6c00d8b5f0c3527f154d296f91b92bea982f24de0f6ef81adf8299d77 WatchSource:0}: Error finding container 0a8ef8a6c00d8b5f0c3527f154d296f91b92bea982f24de0f6ef81adf8299d77: Status 404 returned error can't find the container with id 0a8ef8a6c00d8b5f0c3527f154d296f91b92bea982f24de0f6ef81adf8299d77 Jun 11 18:36:36.807807 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:36:36.807785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951b10b5_5d28_4b30_b803_cec503fae978.slice/crio-94f551768af139cf884bbd1ccbf8ae3dddba5a9086866f5e46c1ea19945e70fc WatchSource:0}: Error finding container 94f551768af139cf884bbd1ccbf8ae3dddba5a9086866f5e46c1ea19945e70fc: Status 404 returned error can't find the container with id 94f551768af139cf884bbd1ccbf8ae3dddba5a9086866f5e46c1ea19945e70fc Jun 11 18:36:36.859450 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.859420 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:36.970385 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:36.970310 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.093522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.093685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.093698 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.093769 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:36:38.093747007 +0000 UTC m=+3.046549392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.093808 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:37.094054 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.093858 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:38.093842467 +0000 UTC m=+3.046644841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:37.195214 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.194896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:37.195214 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.195092 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:37.195214 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.195118 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:37.195214 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.195132 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:37.195214 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:37.195195 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:36:38.19517583 +0000 UTC m=+3.147978203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:37.431640 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.431473 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:31:36 +0000 UTC" deadline="2028-01-02 17:02:27.620555496 +0000 UTC" Jun 11 18:36:37.431640 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.431540 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13678h25m50.189019781s" Jun 11 18:36:37.488324 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.488263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" event={"ID":"894fe180e31fefee1f1a3611f2e490a8","Type":"ContainerStarted","Data":"c8e18f245a005cba8d7bb88b8dff5e6d345a678f4516775a6c96b497130c5422"} Jun 11 18:36:37.498035 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.497996 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nldxm" event={"ID":"2552f7c5-7246-444e-91d9-0e05ee06c6c6","Type":"ContainerStarted","Data":"edb22b5679a130e03d5a5225f610924faccfba58c95ddaf5ff3db32f06de4069"} Jun 11 18:36:37.521893 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.521853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerStarted","Data":"d34b8c4e48cbd962b6857e96b12f285248ef4816067eceb2158d3fb5abe81c2c"} Jun 11 18:36:37.559868 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.559749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" event={"ID":"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6","Type":"ContainerStarted","Data":"0a774733383065d1ebdd4f58b81337c3e57048871c426889c5b0039152324b2c"} Jun 11 18:36:37.589537 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.589495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" event={"ID":"08e45fe30cb4777b4725763e55e81d4a","Type":"ContainerStarted","Data":"f1ff02e749bf0885337467ab44addbfd9867438d41afaffba910c6514263d011"} Jun 11 18:36:37.614405 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.614364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsxm4" event={"ID":"951b10b5-5d28-4b30-b803-cec503fae978","Type":"ContainerStarted","Data":"94f551768af139cf884bbd1ccbf8ae3dddba5a9086866f5e46c1ea19945e70fc"} Jun 11 18:36:37.620723 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.620661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cz27w" event={"ID":"e7f407b2-cfd8-4565-af28-70616f6e1b95","Type":"ContainerStarted","Data":"0a8ef8a6c00d8b5f0c3527f154d296f91b92bea982f24de0f6ef81adf8299d77"} Jun 11 18:36:37.637876 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.637817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" event={"ID":"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20","Type":"ContainerStarted","Data":"81a3926b048fc21e1f4a43777ea5b347f0e12a76c140f772f42e90cb871e00b2"} Jun 11 18:36:37.663451 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.663401 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cz4xx" event={"ID":"428e54f8-d8db-4e06-8387-44a80d9e237d","Type":"ContainerStarted","Data":"8217c6ca8d8943b887bab2cd6cdd0afebd87f99313dd476e167cd7591e82ba7c"} Jun 11 18:36:37.670582 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.670552 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:37.686059 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.685957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"110e59c0b3133037319152ec7d3e3e74e358470ab514d712b428df2ad6ab3da5"} Jun 11 18:36:37.697505 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:37.697459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twpkn" event={"ID":"90687bce-fed4-427e-906d-010c50f2e0b4","Type":"ContainerStarted","Data":"be7bdde9d5e6d077133452b1342819750bb8faae9449e8dda09d254b66b00b92"} Jun 11 18:36:38.101921 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.101835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:38.101921 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.101916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:38.102159 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.102058 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:38.102159 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.102127 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:40.102100246 +0000 UTC m=+5.054902624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:38.102549 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.102517 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:38.102625 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.102575 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:36:40.102557304 +0000 UTC m=+5.055359676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:38.203477 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.202550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:38.203477 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.202742 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:38.203477 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.202768 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:38.203477 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.202780 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:38.203477 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.202851 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:36:40.202816663 +0000 UTC m=+5.155619036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:38.432238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.432148 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:31:36 +0000 UTC" deadline="2027-11-07 14:20:11.973114387 +0000 UTC" Jun 11 18:36:38.432238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.432189 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12331h43m33.540929973s" Jun 11 18:36:38.451625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.451594 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:38.451808 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.451753 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:38.452195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.452173 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:38.452295 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.452275 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:38.452407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:38.452337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:38.452522 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:38.452402 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.119685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.119759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.119878 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.119936 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:44.119917762 +0000 UTC m=+9.072720140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.120000 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:40.120375 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.120034 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:36:44.120023522 +0000 UTC m=+9.072825900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:40.220295 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.220254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:40.220448 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.220405 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:40.220448 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.220430 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:40.220448 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.220444 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:40.220620 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.220505 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:36:44.220485468 +0000 UTC m=+9.173287847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:40.452475 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.452392 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:40.452754 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.452540 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:40.452754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.452631 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:40.452914 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.452774 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:40.452914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:40.452807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:40.452914 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:40.452881 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:42.452495 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:42.452457 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:42.452957 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:42.452612 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:42.453140 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:42.453078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:42.453225 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:42.453184 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:42.453225 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:42.453213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:42.453364 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:42.453281 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:44.154410 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.154368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:44.154908 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.154444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:44.154908 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.154517 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:44.154908 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.154549 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:44.154908 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.154581 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:36:52.154562245 +0000 UTC m=+17.107364635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:44.154908 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.154600 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:52.154590576 +0000 UTC m=+17.107392952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:44.256284 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.255609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:44.256284 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.255853 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:44.256284 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.255875 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:44.256284 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.255888 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:44.256284 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.255947 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:36:52.255928863 +0000 UTC m=+17.208731237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:44.452101 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.451709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:44.452101 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.451841 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:44.452101 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.452062 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:44.452379 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:44.452165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:44.452379 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.452259 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:44.452379 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:44.452317 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:46.451818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:46.451781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:46.452273 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:46.451921 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:46.452273 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:46.451928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:46.452273 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:46.451958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:46.452273 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:46.452032 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:46.452273 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:46.452101 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:48.452051 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:48.451968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:48.452461 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:48.451978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:48.452461 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:48.452114 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:48.452461 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:48.451980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:48.452461 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:48.452184 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:48.452461 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:48.452240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:50.452164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:50.452128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:50.452631 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:50.452309 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:50.452631 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:50.452316 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:50.452631 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:50.452336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:50.452631 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:50.452427 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:50.452631 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:50.452490 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:52.214452 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.214412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:52.214930 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.214498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:52.214930 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.214575 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:52.214930 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.214617 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:52.214930 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.214674 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:37:08.214636967 +0000 UTC m=+33.167439354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:52.214930 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.214697 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:08.214685463 +0000 UTC m=+33.167487848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:52.315091 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.315054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:52.315313 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.315242 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:52.315313 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.315265 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:52.315313 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.315274 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:52.315451 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.315339 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:37:08.315318755 +0000 UTC m=+33.268121131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:52.452051 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.452018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:52.452231 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.452019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:52.452231 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.452144 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:52.452231 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:52.452019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:52.452390 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.452231 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:52.452390 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:52.452303 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:54.452343 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:54.452307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:54.452814 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:54.452347 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:54.452814 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:54.452307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:54.452814 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:54.452422 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:54.452814 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:54.452512 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:54.452814 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:54.452614 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:56.452264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.452239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:56.452518 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.452253 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:56.452518 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.452352 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:56.452518 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:56.452358 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:56.452518 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:56.452418 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:56.452688 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:56.452532 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:56.752317 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.752036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" event={"ID":"9dbcecc1-f08a-480b-bf0e-e3e39d3e92e6","Type":"ContainerStarted","Data":"a970109abbb0a50ffe484dafa1c535f6940292a78655a272977a2af9eff518ec"} Jun 11 18:36:56.753820 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.753792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" event={"ID":"08e45fe30cb4777b4725763e55e81d4a","Type":"ContainerStarted","Data":"a40d15151c00a9093527aed4dda46e4a93aadc4ff3ae8a9b31c59e3aeb88d272"} Jun 11 18:36:56.755218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.755191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsxm4" event={"ID":"951b10b5-5d28-4b30-b803-cec503fae978","Type":"ContainerStarted","Data":"9f7746d9271fc241ef2c7e9d99e45fb9a0cd099a5330ffcb433b0a70c5adc260"} Jun 11 18:36:56.776575 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.775907 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8jmrj" podStartSLOduration=2.205021987 podStartE2EDuration="21.775890056s" totalImagesPullingTime="19.570868069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:56.775375438 +0000 UTC m=+21.728177860" watchObservedRunningTime="2026-06-11 18:36:56.775890056 +0000 UTC m=+21.728692450" Jun 11 18:36:56.795372 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.795322 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lsxm4" podStartSLOduration=2.318126765 podStartE2EDuration="21.795302445s" totalImagesPullingTime="19.47717568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:56.795064301 +0000 UTC m=+21.747866705" watchObservedRunningTime="2026-06-11 18:36:56.795302445 +0000 UTC m=+21.748104841" Jun 11 18:36:56.809492 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:56.809441 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-119.ec2.internal" podStartSLOduration=20.809420548 podStartE2EDuration="20.809420548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:56.808714315 +0000 UTC m=+21.761516733" watchObservedRunningTime="2026-06-11 18:36:56.809420548 +0000 UTC m=+21.762222943" Jun 11 18:36:57.759985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.759821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760262 2567 generic.go:356] "Generic (PLEG): container finished" podID="9834d578-89cf-4069-8b1a-d3c05604129a" containerID="f9bdbc728fd142d4de4c17c70b4b5312dca578db486e4f43cfb483ee95e696ec" exitCode=1 Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"27975225dd53446358080ddde78106c22fc6d31913aaa445d5ea6b1b9fcf5260"} Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"eb5027a0d90feda32c364cac1a1e7cf3d795b07ad00d875dda930459bf61b21c"} Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760436 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"74a60c792ea315f3de510991dbd9fd3b2b5a7fffd78701182eccadcca1995dfc"} Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"8dbde962bdb36a7e4a5693a9681c5b4e48bda07660bd952a992f90531d746dc6"} Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760505 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerDied","Data":"f9bdbc728fd142d4de4c17c70b4b5312dca578db486e4f43cfb483ee95e696ec"} Jun 11 18:36:57.760553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.760553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"e53d3de5441b7d9199ac226c47d4fc4776dc58c9326ef5f0744acd2f2f688508"} Jun 11 18:36:57.761745 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.761715 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twpkn" event={"ID":"90687bce-fed4-427e-906d-010c50f2e0b4","Type":"ContainerStarted","Data":"0d1ffa7674bb5c5c1f859f95fc087f0c6599e6ac5fe99dd1ef375a92b83ce9ce"} Jun 11 18:36:57.763074 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.763056 2567 generic.go:356] "Generic (PLEG): container finished" podID="894fe180e31fefee1f1a3611f2e490a8" containerID="9aaa606b4c7097a84dd9644fecd124c2ca7f517ece833e26b2b34f25f42fbad5" exitCode=0 Jun 11 18:36:57.763153 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.763122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" event={"ID":"894fe180e31fefee1f1a3611f2e490a8","Type":"ContainerDied","Data":"9aaa606b4c7097a84dd9644fecd124c2ca7f517ece833e26b2b34f25f42fbad5"} Jun 11 18:36:57.764395 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.764374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nldxm" event={"ID":"2552f7c5-7246-444e-91d9-0e05ee06c6c6","Type":"ContainerStarted","Data":"6a1be4a3e2b15930781767339d5ef1f578a01a2d9d47af9396149c2b82314d2c"} Jun 11 18:36:57.765705 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.765685 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="62dd5a24676fb565336b9155d7e96b477aaa7f8036b9c62fa6d3b4415d612820" exitCode=0 Jun 11 18:36:57.765794 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.765764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"62dd5a24676fb565336b9155d7e96b477aaa7f8036b9c62fa6d3b4415d612820"} Jun 11 18:36:57.767182 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.767162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cz27w" event={"ID":"e7f407b2-cfd8-4565-af28-70616f6e1b95","Type":"ContainerStarted","Data":"bc636d0137a2d8399891aed4bfb96502d9cb050378a2a5911e7c59995af6136a"} Jun 11 18:36:57.768586 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.768563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" event={"ID":"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20","Type":"ContainerStarted","Data":"c1be460eceb933c108a356fa8f24d38a9f77efcbb7e9f177b683bf5a9dfc5618"} Jun 11 18:36:57.769878 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.769852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cz4xx" event={"ID":"428e54f8-d8db-4e06-8387-44a80d9e237d","Type":"ContainerStarted","Data":"08c77a0045ec7a76edc441e77da8a94f602116d9664c04c4c88768029ae684f0"} Jun 11 18:36:57.779543 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.779508 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-twpkn" podStartSLOduration=3.257133878 podStartE2EDuration="22.779497765s" totalImagesPullingTime="19.522363887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:57.779131137 +0000 UTC m=+22.731933557" watchObservedRunningTime="2026-06-11 18:36:57.779497765 +0000 UTC m=+22.732300158" Jun 11 18:36:57.832123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.832058 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cz4xx" podStartSLOduration=3.433890765 podStartE2EDuration="22.832040673s" totalImagesPullingTime="19.398149908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:57.83108854 +0000 UTC m=+22.783890937" watchObservedRunningTime="2026-06-11 18:36:57.832040673 +0000 UTC m=+22.784843068" Jun 11 18:36:57.853624 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.853598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.863713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.863674 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cz27w" podStartSLOduration=3.388568132 podStartE2EDuration="22.863640398s" totalImagesPullingTime="19.475072266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:57.849035975 +0000 UTC m=+22.801838370" watchObservedRunningTime="2026-06-11 18:36:57.863640398 +0000 UTC m=+22.816442792" Jun 11 18:36:57.882533 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.882496 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nldxm" podStartSLOduration=3.360735336 podStartE2EDuration="22.882487189s" totalImagesPullingTime="19.521751853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:57.882215486 +0000 UTC m=+22.835017880" watchObservedRunningTime="2026-06-11 18:36:57.882487189 +0000 UTC m=+22.835289584" Jun 11 18:36:57.918570 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:57.918544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:58.019374 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.019346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:58.204851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.204757 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:58.423996 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.423950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:58.452199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.452167 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:36:58.452346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.452258 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:36:58.452346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.452277 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:36:58.452463 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:58.452390 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:36:58.452518 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:58.452478 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:36:58.452570 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:36:58.452552 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:36:58.774711 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.774439 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" event={"ID":"894fe180e31fefee1f1a3611f2e490a8","Type":"ContainerStarted","Data":"e5161b5ce1448c77fc042597407e3ca648ffd01bce7617fa831f08d4f3241929"} Jun 11 18:36:58.794284 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.794234 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-119.ec2.internal" podStartSLOduration=22.794219046 podStartE2EDuration="22.794219046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:58.794057628 +0000 UTC m=+23.746860022" watchObservedRunningTime="2026-06-11 18:36:58.794219046 +0000 UTC m=+23.747021439" Jun 11 18:36:58.811551 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.811525 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 18:36:58.816928 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:58.816866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:59.415852 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.415790 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:59.453202 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.453089 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T18:36:58.811545986Z","UUID":"6fa52586-aa9c-47c5-af6a-b6022c44ca04","Handler":null,"Name":"","Endpoint":""} Jun 11 18:36:59.455195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.455082 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 18:36:59.455195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.455124 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 18:36:59.485090 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.485056 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:59.486517 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.486495 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:59.522404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.522372 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:59.779919 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.779799 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" event={"ID":"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20","Type":"ContainerStarted","Data":"b79fc5d210144789b2aa4a17a519bd1d830ffa614715cf47f8c93ba2142c3a84"} Jun 11 18:36:59.783640 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.783613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:36:59.784075 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.784045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"f493e4b4d6b669953870d7331b04ada6cc616775eb54464c764442afdfa2934a"} Jun 11 18:36:59.784302 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.784281 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:59.784916 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.784896 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cz4xx" Jun 11 18:36:59.810534 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:36:59.810506 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.018079 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.018034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.182029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.182002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.409143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.409067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.452247 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.452215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:00.452421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.452225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:00.452421 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:00.452332 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:00.452421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.452225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:00.452581 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:00.452427 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:00.452581 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:00.452470 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:00.492827 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.492798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.617806 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.617773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.789036 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.788957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" event={"ID":"151fef3b-4514-4e0a-bcc6-ae7c18b3bd20","Type":"ContainerStarted","Data":"7189cf9fdf573383198ea83d2c9b1332058c426dece97b9cce14608ea73f2467"} Jun 11 18:37:00.809658 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.809602 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nkkw" podStartSLOduration=3.938332509 podStartE2EDuration="25.809582046s" totalImagesPullingTime="21.871249537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:00.809020819 +0000 UTC m=+25.761823230" watchObservedRunningTime="2026-06-11 18:37:00.809582046 +0000 UTC m=+25.762384442" Jun 11 18:37:00.893340 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.893302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:00.993143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:00.993115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.048544 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.048460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.137073 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.137035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.237913 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.237880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.305145 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.305067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.382359 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.382328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.549852 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.549817 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.612760 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.612684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:01.801900 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:01.801863 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.005301 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.005081 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.156825 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.156764 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.236699 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.236660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.356370 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.356328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.451874 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.451798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:02.452015 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.451897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:02.452015 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:02.451898 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:02.452015 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:02.451996 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:02.452179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.452027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:02.452179 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:02.452120 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:02.543815 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.543782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.604000 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.603971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:02.796153 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.796089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:37:02.796489 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.796468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"81fafbc6766cc8aa44001fae9847485287f3cd0d0294340e6f6e8066489baaf3"} Jun 11 18:37:02.796806 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.796784 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:02.796921 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.796857 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:02.797090 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.797069 2567 scope.go:117] "RemoveContainer" containerID="f9bdbc728fd142d4de4c17c70b4b5312dca578db486e4f43cfb483ee95e696ec" Jun 11 18:37:02.798583 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.798562 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="121ebf3ceabe842fdf4b779b32c969431b007ae243964934cd7c0b77c64c0bd5" exitCode=0 Jun 11 18:37:02.798672 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.798593 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"121ebf3ceabe842fdf4b779b32c969431b007ae243964934cd7c0b77c64c0bd5"} Jun 11 18:37:02.812867 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.812849 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:02.966465 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:02.966426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:03.067436 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.067365 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:03.804051 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.803893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:37:03.804380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.804361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" event={"ID":"9834d578-89cf-4069-8b1a-d3c05604129a","Type":"ContainerStarted","Data":"9f161f8e6d4a478b364605d581ad3927a37656d4a1018272a138d498d2658643"} Jun 11 18:37:03.820657 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.820623 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:03.837536 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.837516 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:03.854410 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:03.854360 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" podStartSLOduration=8.826090826 podStartE2EDuration="28.854342184s" totalImagesPullingTime="20.028251358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:03.852786869 +0000 UTC m=+28.805589264" watchObservedRunningTime="2026-06-11 18:37:03.854342184 +0000 UTC m=+28.807144580" Jun 11 18:37:04.451879 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:04.451852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:04.452045 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:04.451852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:04.452045 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:04.451943 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:04.452045 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:04.451852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:04.452045 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:04.452020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:04.452199 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:04.452071 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:04.808266 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:04.808188 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="0f21ae2243ed3ea32de03c9b8b7a001581cbd945f3bf443e27d03359b99ea32d" exitCode=0 Jun 11 18:37:04.808433 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:04.808267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"0f21ae2243ed3ea32de03c9b8b7a001581cbd945f3bf443e27d03359b99ea32d"} Jun 11 18:37:05.810109 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:05.810071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:06.452016 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:06.451987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:06.452195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:06.452082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:06.452195 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:06.452086 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:06.452195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:06.452093 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:06.452195 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:06.452169 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:06.452332 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:06.452270 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:06.814290 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:06.814209 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="50218b41b75fb4633cab8d1100b14e0ac0298257374c1178923e7477723f87c2" exitCode=0 Jun 11 18:37:06.814290 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:06.814251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"50218b41b75fb4633cab8d1100b14e0ac0298257374c1178923e7477723f87c2"} Jun 11 18:37:08.239849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.239808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:08.240387 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.239869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:08.240387 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.239977 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:37:08.240387 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.240038 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs podName:bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:40.240022453 +0000 UTC m=+65.192824829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs") pod "network-metrics-daemon-qvzd5" (UID: "bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:37:08.240387 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.239977 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:08.240387 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.240141 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret podName:24977f59-bbbd-46e6-8455-a65836976c6f nodeName:}" failed. No retries permitted until 2026-06-11 18:37:40.240114744 +0000 UTC m=+65.192917132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret") pod "global-pull-secret-syncer-x96t8" (UID: "24977f59-bbbd-46e6-8455-a65836976c6f") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:08.340938 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.340902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:08.341108 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.341070 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:37:08.341108 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.341089 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:37:08.341108 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.341098 2567 projected.go:196] Error preparing data for projected volume kube-api-access-s7vvm for pod openshift-network-diagnostics/network-check-target-hv88l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:37:08.341248 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.341155 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm podName:383447f3-5236-4207-8de9-69063a231aed nodeName:}" failed. No retries permitted until 2026-06-11 18:37:40.341136044 +0000 UTC m=+65.293938416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7vvm" (UniqueName: "kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm") pod "network-check-target-hv88l" (UID: "383447f3-5236-4207-8de9-69063a231aed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:37:08.452027 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.451993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:08.452211 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.451993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:08.452211 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.452126 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:08.452211 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:08.451993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:08.452365 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.452211 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:08.452365 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:08.452257 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:09.269252 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:09.269215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:09.391313 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:09.391276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:10.452410 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:10.452377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:10.452855 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:10.452418 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:10.452855 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:10.452492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:10.452855 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:10.452507 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:10.452855 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:10.452578 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:10.452855 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:10.452633 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:10.825970 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:10.825939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerStarted","Data":"568927a9889f410fa8236730a9cfe64fb898abe47c136c30f91befad7c98c066"} Jun 11 18:37:11.830500 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:11.830469 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="568927a9889f410fa8236730a9cfe64fb898abe47c136c30f91befad7c98c066" exitCode=0 Jun 11 18:37:11.830900 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:11.830510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"568927a9889f410fa8236730a9cfe64fb898abe47c136c30f91befad7c98c066"} Jun 11 18:37:12.168091 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.168012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:12.452004 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.451928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:12.452004 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.451965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:12.452171 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.451928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:12.452171 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:12.452078 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:12.452171 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:12.452068 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:12.452171 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:12.452152 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:12.835607 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.835577 2567 generic.go:356] "Generic (PLEG): container finished" podID="6de2aab9-530b-457e-b4d0-580da9909cfc" containerID="9d7bbf3eca582dc79641c9771c4b4931112090324d9b1a54a69d7bb704254082" exitCode=0 Jun 11 18:37:12.835963 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:12.835617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerDied","Data":"9d7bbf3eca582dc79641c9771c4b4931112090324d9b1a54a69d7bb704254082"} Jun 11 18:37:13.569077 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:13.569044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:13.841260 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:13.841186 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cld4v" event={"ID":"6de2aab9-530b-457e-b4d0-580da9909cfc","Type":"ContainerStarted","Data":"e9b7f8da0b3841d0f42ec781a0fc8c380c032bb6613618e572705abae23ac241"} Jun 11 18:37:13.864752 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:13.864710 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cld4v" podStartSLOduration=9.355019389 podStartE2EDuration="38.864697713s" totalImagesPullingTime="29.509678324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:13.864584292 +0000 UTC m=+38.817386685" watchObservedRunningTime="2026-06-11 18:37:13.864697713 +0000 UTC m=+38.817500106" Jun 11 18:37:14.452012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:14.451976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:14.452012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:14.451997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:14.452012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:14.451986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:14.452258 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:14.452087 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:14.452258 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:14.452199 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:14.452258 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:14.452250 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:14.896139 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:14.896106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:14.996463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:14.996434 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:15.097084 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:15.097030 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:15.153265 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:15.153185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:16.451875 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:16.451845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:16.452346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:16.451931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:16.452346 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:16.451936 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:16.452346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:16.451956 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:16.452346 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:16.452033 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:16.452346 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:16.452104 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:16.770987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:16.770960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:16.824871 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:16.824840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:17.999601 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:17.999528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:18.451779 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:18.451741 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:18.451779 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:18.451775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:18.451993 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:18.451775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:18.451993 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:18.451846 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:18.451993 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:18.451922 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:18.451993 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:18.451978 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:19.727151 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:19.727123 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:19.827225 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:19.827196 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:20.452344 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.452315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:20.452528 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.452315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:20.452528 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:20.452432 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:20.452528 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.452316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:20.452528 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:20.452483 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:20.452789 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:20.452552 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:20.523290 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.523262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:20.623526 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.623496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:20.690013 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:20.689984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:22.451876 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:22.451836 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:22.452440 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:22.451853 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:22.452583 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:22.452545 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:22.452919 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:22.452894 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:22.453106 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:22.453091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:22.453233 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:22.453217 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:24.451573 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:24.451539 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:24.451573 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:24.451580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:24.452071 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:24.451677 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:24.452071 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:24.451718 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:24.452071 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:24.451768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:24.452071 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:24.451874 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:25.263638 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:25.263610 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:26.289334 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.289304 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:26.389716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.389680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:26.445458 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.445431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:26.452508 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.452490 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:26.452608 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.452491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:26.452608 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:26.452579 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:26.452740 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:26.452490 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:26.452816 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:26.452720 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:26.452878 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:26.452797 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:27.276240 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:27.276209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:27.342543 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:27.342515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:27.798112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:27.798083 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:28.420937 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:28.420909 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:28.451721 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:28.451701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:28.451835 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:28.451700 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:28.451835 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:28.451785 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:28.451916 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:28.451703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:28.451956 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:28.451858 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:28.451956 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:28.451939 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:29.522277 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.522098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:29.605087 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.605062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:29.797833 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.797755 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:29.802328 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.802303 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvzd5"] Jun 11 18:37:29.802457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.802401 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:29.802538 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:29.802518 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:29.805399 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.805377 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x96t8"] Jun 11 18:37:29.805516 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.805457 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:29.805562 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:29.805543 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:29.806229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.806205 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv88l"] Jun 11 18:37:29.806336 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.806284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:29.806397 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:29.806357 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:29.863309 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:29.863277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:31.452438 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:31.452402 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:31.452949 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:31.452445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:31.452949 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:31.452535 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x96t8" podUID="24977f59-bbbd-46e6-8455-a65836976c6f" Jun 11 18:37:31.452949 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:31.452623 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:31.452949 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:31.452615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvzd5" podUID="bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1" Jun 11 18:37:31.452949 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:31.452741 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv88l" podUID="383447f3-5236-4207-8de9-69063a231aed" Jun 11 18:37:32.503756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:32.503726 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:32.604177 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:32.604148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:33.309987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.309961 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-119.ec2.internal" event="NodeReady" Jun 11 18:37:33.310139 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.310094 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 18:37:33.358716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.358622 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hv2ct"] Jun 11 18:37:33.360457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.360437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.362371 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.362350 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nnptq"] Jun 11 18:37:33.363663 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.363634 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 18:37:33.364071 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.364054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.364156 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.364087 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhg9x\"" Jun 11 18:37:33.364208 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.364181 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 18:37:33.366371 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.366354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 18:37:33.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.366357 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 18:37:33.366965 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.366952 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 18:37:33.367662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.367471 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 18:37:33.367662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.367618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rbv24\"" Jun 11 18:37:33.372906 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.372878 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hv2ct"] Jun 11 18:37:33.376079 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.376058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnptq"] Jun 11 18:37:33.447241 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d82e8019-a7bb-4387-ae86-15151a6f5e0b-crio-socket\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.447358 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6217a90d-93d9-4041-b84a-c4bd6cdb0050-metrics-tls\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.447358 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d82e8019-a7bb-4387-ae86-15151a6f5e0b-data-volume\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.447358 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d82e8019-a7bb-4387-ae86-15151a6f5e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.447484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvk8\" (UniqueName: \"kubernetes.io/projected/6217a90d-93d9-4041-b84a-c4bd6cdb0050-kube-api-access-fjvk8\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.447484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvx7\" (UniqueName: \"kubernetes.io/projected/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-api-access-ftvx7\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.447484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6217a90d-93d9-4041-b84a-c4bd6cdb0050-tmp-dir\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.447484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.447484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.447476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6217a90d-93d9-4041-b84a-c4bd6cdb0050-config-volume\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.452300 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.452281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:33.452393 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.452283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:33.452465 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.452452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:33.455176 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455152 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:37:33.455280 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455175 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ptdz8\"" Jun 11 18:37:33.455280 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:37:33.455280 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455273 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:37:33.455454 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qf6vw\"" Jun 11 18:37:33.455527 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.455508 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:37:33.460999 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.460981 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dl8rx"] Jun 11 18:37:33.462833 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.462818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.465914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.465897 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 18:37:33.465914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.465920 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nsdln\"" Jun 11 18:37:33.466331 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.466316 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 18:37:33.466411 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.466350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 18:37:33.476497 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.476479 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl8rx"] Jun 11 18:37:33.532382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.532349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:33.548724 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6217a90d-93d9-4041-b84a-c4bd6cdb0050-config-volume\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.548829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d82e8019-a7bb-4387-ae86-15151a6f5e0b-crio-socket\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.548829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6217a90d-93d9-4041-b84a-c4bd6cdb0050-metrics-tls\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.548829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d82e8019-a7bb-4387-ae86-15151a6f5e0b-data-volume\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.548829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d82e8019-a7bb-4387-ae86-15151a6f5e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c593b2-9245-45cf-8b0e-750f948e7d74-cert\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvk8\" (UniqueName: \"kubernetes.io/projected/6217a90d-93d9-4041-b84a-c4bd6cdb0050-kube-api-access-fjvk8\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvx7\" (UniqueName: \"kubernetes.io/projected/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-api-access-ftvx7\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6217a90d-93d9-4041-b84a-c4bd6cdb0050-tmp-dir\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.548997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.549029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6z4\" (UniqueName: \"kubernetes.io/projected/32c593b2-9245-45cf-8b0e-750f948e7d74-kube-api-access-fr6z4\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.549319 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d82e8019-a7bb-4387-ae86-15151a6f5e0b-data-volume\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.549319 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6217a90d-93d9-4041-b84a-c4bd6cdb0050-tmp-dir\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.549418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6217a90d-93d9-4041-b84a-c4bd6cdb0050-config-volume\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.549462 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d82e8019-a7bb-4387-ae86-15151a6f5e0b-crio-socket\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.549588 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.549564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.552620 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.552602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6217a90d-93d9-4041-b84a-c4bd6cdb0050-metrics-tls\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.552741 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.552727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d82e8019-a7bb-4387-ae86-15151a6f5e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.558531 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.558503 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvx7\" (UniqueName: \"kubernetes.io/projected/d82e8019-a7bb-4387-ae86-15151a6f5e0b-kube-api-access-ftvx7\") pod \"insights-runtime-extractor-nnptq\" (UID: \"d82e8019-a7bb-4387-ae86-15151a6f5e0b\") " pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.558531 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.558525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvk8\" (UniqueName: \"kubernetes.io/projected/6217a90d-93d9-4041-b84a-c4bd6cdb0050-kube-api-access-fjvk8\") pod \"dns-default-hv2ct\" (UID: \"6217a90d-93d9-4041-b84a-c4bd6cdb0050\") " pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.619263 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.619184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:33.649841 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.649817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c593b2-9245-45cf-8b0e-750f948e7d74-cert\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.649929 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.649876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6z4\" (UniqueName: \"kubernetes.io/projected/32c593b2-9245-45cf-8b0e-750f948e7d74-kube-api-access-fr6z4\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.652099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.652083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32c593b2-9245-45cf-8b0e-750f948e7d74-cert\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.659193 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.659173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6z4\" (UniqueName: \"kubernetes.io/projected/32c593b2-9245-45cf-8b0e-750f948e7d74-kube-api-access-fr6z4\") pod \"ingress-canary-dl8rx\" (UID: \"32c593b2-9245-45cf-8b0e-750f948e7d74\") " pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.672070 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.672043 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:33.679083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.679068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnptq" Jun 11 18:37:33.686421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.686317 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:33.779072 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.779046 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl8rx" Jun 11 18:37:33.818287 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.818252 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnptq"] Jun 11 18:37:33.825865 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.825799 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hv2ct"] Jun 11 18:37:33.829783 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:33.829748 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6217a90d_93d9_4041_b84a_c4bd6cdb0050.slice/crio-373a1973cf49a45a5791deb58d83a629b91ed1ac2dc5c6d0c3f27648d3fe4ebb WatchSource:0}: Error finding container 373a1973cf49a45a5791deb58d83a629b91ed1ac2dc5c6d0c3f27648d3fe4ebb: Status 404 returned error can't find the container with id 373a1973cf49a45a5791deb58d83a629b91ed1ac2dc5c6d0c3f27648d3fe4ebb Jun 11 18:37:33.880197 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.880126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv2ct" event={"ID":"6217a90d-93d9-4041-b84a-c4bd6cdb0050","Type":"ContainerStarted","Data":"373a1973cf49a45a5791deb58d83a629b91ed1ac2dc5c6d0c3f27648d3fe4ebb"} Jun 11 18:37:33.881314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.881263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnptq" event={"ID":"d82e8019-a7bb-4387-ae86-15151a6f5e0b","Type":"ContainerStarted","Data":"f24a01270d9fc611be72c5b10257bc0deec6bfb8702c9f7ea2cd0610cfbc8a25"} Jun 11 18:37:33.901569 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:33.901540 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl8rx"] Jun 11 18:37:33.904845 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:33.904819 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c593b2_9245_45cf_8b0e_750f948e7d74.slice/crio-6f9dc6502e9d66bdf4d4bd488774c122d0a2c91af735e523f1dbcc490be000a5 WatchSource:0}: Error finding container 6f9dc6502e9d66bdf4d4bd488774c122d0a2c91af735e523f1dbcc490be000a5: Status 404 returned error can't find the container with id 6f9dc6502e9d66bdf4d4bd488774c122d0a2c91af735e523f1dbcc490be000a5 Jun 11 18:37:34.038904 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:34.038876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:34.097314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:34.097269 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:34.887333 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:34.887298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl8rx" event={"ID":"32c593b2-9245-45cf-8b0e-750f948e7d74","Type":"ContainerStarted","Data":"6f9dc6502e9d66bdf4d4bd488774c122d0a2c91af735e523f1dbcc490be000a5"} Jun 11 18:37:35.079185 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:35.079153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:35.134849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:35.134814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:35.824717 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:35.824687 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67cvn" Jun 11 18:37:37.443877 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:37.443833 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:38.667547 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.667511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:38.727980 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.727899 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:38.898222 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.898191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnptq" event={"ID":"d82e8019-a7bb-4387-ae86-15151a6f5e0b","Type":"ContainerStarted","Data":"e7befe174cb32cedf54168ca086198dcad5fc0b59539000f6f8d01159976da5c"} Jun 11 18:37:38.899546 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.899523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl8rx" event={"ID":"32c593b2-9245-45cf-8b0e-750f948e7d74","Type":"ContainerStarted","Data":"8303a0599765a36e6766513f243c2e0d04668e698c5f6f654f200f2d06da51c8"} Jun 11 18:37:38.901081 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.901062 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv2ct" event={"ID":"6217a90d-93d9-4041-b84a-c4bd6cdb0050","Type":"ContainerStarted","Data":"d682ac7b88bb9757939b30150ee8c6fa9828033b22f2f01eff437c505f4aa799"} Jun 11 18:37:38.901163 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.901097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hv2ct" event={"ID":"6217a90d-93d9-4041-b84a-c4bd6cdb0050","Type":"ContainerStarted","Data":"a525e221037e0f19df0dfbd01e562610fe8ae40309992594e7c6f3ba793d9376"} Jun 11 18:37:38.901227 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.901211 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:38.914788 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.914737 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dl8rx" podStartSLOduration=1.374045419 podStartE2EDuration="5.914721237s" totalImagesPullingTime="4.540675818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:38.914404963 +0000 UTC m=+63.867207375" watchObservedRunningTime="2026-06-11 18:37:38.914721237 +0000 UTC m=+63.867523633" Jun 11 18:37:38.933859 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:38.933798 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hv2ct" podStartSLOduration=1.319474881 podStartE2EDuration="5.933776198s" totalImagesPullingTime="4.614301317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:38.933294689 +0000 UTC m=+63.886097084" watchObservedRunningTime="2026-06-11 18:37:38.933776198 +0000 UTC m=+63.886578593" Jun 11 18:37:39.088677 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:39.088628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:39.163602 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:39.163569 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:39.265417 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:39.265385 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:39.749861 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:39.749827 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:39.907750 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:39.907710 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnptq" event={"ID":"d82e8019-a7bb-4387-ae86-15151a6f5e0b","Type":"ContainerStarted","Data":"4234b921a74e7271ce8c7c923d4bbe26df9460a950942309d5672923e58c1d4a"} Jun 11 18:37:40.041977 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.041946 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:40.306380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.306301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:40.306380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.306358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:40.309041 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.309014 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:37:40.310050 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.310033 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:37:40.319229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.319199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24977f59-bbbd-46e6-8455-a65836976c6f-original-pull-secret\") pod \"global-pull-secret-syncer-x96t8\" (UID: \"24977f59-bbbd-46e6-8455-a65836976c6f\") " pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:40.319336 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.319309 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1-metrics-certs\") pod \"network-metrics-daemon-qvzd5\" (UID: \"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1\") " pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:40.364368 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.364344 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qf6vw\"" Jun 11 18:37:40.367581 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.367564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x96t8" Jun 11 18:37:40.372543 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.372526 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvzd5" Jun 11 18:37:40.407591 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.407561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:40.410404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.410375 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:37:40.421316 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.421288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:37:40.432187 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.432156 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vvm\" (UniqueName: \"kubernetes.io/projected/383447f3-5236-4207-8de9-69063a231aed-kube-api-access-s7vvm\") pod \"network-check-target-hv88l\" (UID: \"383447f3-5236-4207-8de9-69063a231aed\") " pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:40.678083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.678005 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ptdz8\"" Jun 11 18:37:40.685060 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.685036 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:40.837882 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.835277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:40.922551 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.922519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:40.930267 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:40.930162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv88l"] Jun 11 18:37:40.933573 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:40.933547 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383447f3_5236_4207_8de9_69063a231aed.slice/crio-1a37dff68dc8eaa5be2a9eb1ebe3d447f644b4bec38d625b07c6b12949eac177 WatchSource:0}: Error finding container 1a37dff68dc8eaa5be2a9eb1ebe3d447f644b4bec38d625b07c6b12949eac177: Status 404 returned error can't find the container with id 1a37dff68dc8eaa5be2a9eb1ebe3d447f644b4bec38d625b07c6b12949eac177 Jun 11 18:37:41.023110 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.023074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:41.154353 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.154322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvzd5"] Jun 11 18:37:41.155152 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.155058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x96t8"] Jun 11 18:37:41.156937 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:41.156906 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7bc1b2_61ce_4b17_b013_6d1ea5e6a1c1.slice/crio-62cb816f0558b35897783df6460ba4d40b9c96a5c8e2320ef2d7971815602b87 WatchSource:0}: Error finding container 62cb816f0558b35897783df6460ba4d40b9c96a5c8e2320ef2d7971815602b87: Status 404 returned error can't find the container with id 62cb816f0558b35897783df6460ba4d40b9c96a5c8e2320ef2d7971815602b87 Jun 11 18:37:41.157515 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:41.157461 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24977f59_bbbd_46e6_8455_a65836976c6f.slice/crio-8cf7a770dc4705be48c9709eb01b8b0004a2e36d2b11cae9b194510e8d92ab58 WatchSource:0}: Error finding container 8cf7a770dc4705be48c9709eb01b8b0004a2e36d2b11cae9b194510e8d92ab58: Status 404 returned error can't find the container with id 8cf7a770dc4705be48c9709eb01b8b0004a2e36d2b11cae9b194510e8d92ab58 Jun 11 18:37:41.918533 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.918493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvzd5" event={"ID":"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1","Type":"ContainerStarted","Data":"62cb816f0558b35897783df6460ba4d40b9c96a5c8e2320ef2d7971815602b87"} Jun 11 18:37:41.922973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.922941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnptq" event={"ID":"d82e8019-a7bb-4387-ae86-15151a6f5e0b","Type":"ContainerStarted","Data":"975631f55f266baa32626e5b229bee02b768583089761795837b1569196e6b9d"} Jun 11 18:37:41.924594 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.924533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x96t8" event={"ID":"24977f59-bbbd-46e6-8455-a65836976c6f","Type":"ContainerStarted","Data":"8cf7a770dc4705be48c9709eb01b8b0004a2e36d2b11cae9b194510e8d92ab58"} Jun 11 18:37:41.925912 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.925861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv88l" event={"ID":"383447f3-5236-4207-8de9-69063a231aed","Type":"ContainerStarted","Data":"1a37dff68dc8eaa5be2a9eb1ebe3d447f644b4bec38d625b07c6b12949eac177"} Jun 11 18:37:41.943612 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:41.943560 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nnptq" podStartSLOduration=2.058686333 podStartE2EDuration="8.943541197s" totalImagesPullingTime="6.884854864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:41.943454289 +0000 UTC m=+66.896256686" watchObservedRunningTime="2026-06-11 18:37:41.943541197 +0000 UTC m=+66.896343592" Jun 11 18:37:42.691094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:42.691066 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:42.932680 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:42.932626 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvzd5" event={"ID":"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1","Type":"ContainerStarted","Data":"846c15d6d2bb4c9fa892cf0047047d0430a23f43b9b45c586ed181a8dd1215ac"} Jun 11 18:37:42.933149 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:42.932712 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvzd5" event={"ID":"bd7bc1b2-61ce-4b17-b013-6d1ea5e6a1c1","Type":"ContainerStarted","Data":"6261a59d34d3f42d5bfe0e8148d96db8f12bb088a9eb1fb795e842f24d6098b1"} Jun 11 18:37:42.949992 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:42.949867 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qvzd5" podStartSLOduration=66.621573771 podStartE2EDuration="1m7.949849963s" totalImagesPullingTime="1.328276192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:42.949630268 +0000 UTC m=+67.902432689" watchObservedRunningTime="2026-06-11 18:37:42.949849963 +0000 UTC m=+67.902652397" Jun 11 18:37:44.312545 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.312506 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.399358 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.399325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.506157 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.506105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.514177 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.514126 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c"] Jun 11 18:37:44.516434 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.516414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.521590 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.521559 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 18:37:44.522207 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.522182 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 18:37:44.523022 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.522908 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 18:37:44.523022 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.522931 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 18:37:44.523966 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.523451 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dgch7\"" Jun 11 18:37:44.527275 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.527224 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 18:37:44.540211 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.540184 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c"] Jun 11 18:37:44.605819 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.605736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.632460 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.632430 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qxqbn"] Jun 11 18:37:44.634732 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.634707 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg"] Jun 11 18:37:44.634894 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.634875 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.634955 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.634939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.635013 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.634980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.635066 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.635025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.635114 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.635066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhjx\" (UniqueName: \"kubernetes.io/projected/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-kube-api-access-blhjx\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.636745 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.636724 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.638133 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.638114 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 18:37:44.638363 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.638346 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 18:37:44.638624 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.638597 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 18:37:44.638735 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.638712 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qjvwn\"" Jun 11 18:37:44.638979 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.638957 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 18:37:44.639264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.639247 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g2798\"" Jun 11 18:37:44.639446 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.639425 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 18:37:44.639532 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.639512 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 18:37:44.651375 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.651353 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg"] Jun 11 18:37:44.699802 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.699767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.736233 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.736381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-wtmp\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.736381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/954c1a24-a429-4aab-99a9-9a91319cf4bf-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.736381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2kx9\" (UniqueName: \"kubernetes.io/projected/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-api-access-s2kx9\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.736381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.736381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.736628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.736628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j49vl\" (UniqueName: \"kubernetes.io/projected/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-kube-api-access-j49vl\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.736628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-metrics-client-ca\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.736628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.736849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-sys\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.736849 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.736673 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 18:37:44.736849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhjx\" (UniqueName: \"kubernetes.io/projected/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-kube-api-access-blhjx\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.736849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.736849 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.736744 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls podName:833cb9b5-10cb-412d-8fcd-f3280e0dd5b2 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:45.236723818 +0000 UTC m=+70.189526193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-bxw6c" (UID: "833cb9b5-10cb-412d-8fcd-f3280e0dd5b2") : secret "openshift-state-metrics-tls" not found Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-textfile\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.736968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.737008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-root\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.737027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.737143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.737045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.737689 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.737667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.738998 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.738981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.747610 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.747590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhjx\" (UniqueName: \"kubernetes.io/projected/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-kube-api-access-blhjx\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:44.837634 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-wtmp\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/954c1a24-a429-4aab-99a9-9a91319cf4bf-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2kx9\" (UniqueName: \"kubernetes.io/projected/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-api-access-s2kx9\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j49vl\" (UniqueName: \"kubernetes.io/projected/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-kube-api-access-j49vl\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.837809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-metrics-client-ca\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-wtmp\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-sys\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837878 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-textfile\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-root\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.837993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.838131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/954c1a24-a429-4aab-99a9-9a91319cf4bf-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.838261 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.838334 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls podName:d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:45.338312973 +0000 UTC m=+70.291115364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls") pod "node-exporter-qxqbn" (UID: "d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3") : secret "node-exporter-tls" not found Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-textfile\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.838505 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-sys\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838625 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:44.838573 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls podName:954c1a24-a429-4aab-99a9-9a91319cf4bf nodeName:}" failed. No retries permitted until 2026-06-11 18:37:45.338544177 +0000 UTC m=+70.291346549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-z7lvg" (UID: "954c1a24-a429-4aab-99a9-9a91319cf4bf") : secret "kube-state-metrics-tls" not found Jun 11 18:37:44.838992 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-root\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.838992 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.838992 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.838832 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954c1a24-a429-4aab-99a9-9a91319cf4bf-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.839305 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.839282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-metrics-client-ca\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.841083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.841037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.841511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.841491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.849020 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.848997 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j49vl\" (UniqueName: \"kubernetes.io/projected/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-kube-api-access-j49vl\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:44.849461 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.849439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2kx9\" (UniqueName: \"kubernetes.io/projected/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-api-access-s2kx9\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:44.859538 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.859449 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.960418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:44.960384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.060536 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.060500 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.163504 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.163415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.241722 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.241686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:45.244306 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.244283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/833cb9b5-10cb-412d-8fcd-f3280e0dd5b2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bxw6c\" (UID: \"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:45.272952 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.272923 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.342729 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.342689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:45.343203 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.342738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:45.345296 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.345268 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3-node-exporter-tls\") pod \"node-exporter-qxqbn\" (UID: \"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3\") " pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:45.345427 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.345319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/954c1a24-a429-4aab-99a9-9a91319cf4bf-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-z7lvg\" (UID: \"954c1a24-a429-4aab-99a9-9a91319cf4bf\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:45.430568 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.430479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" Jun 11 18:37:45.450688 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.450629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.546957 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.546927 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qxqbn" Jun 11 18:37:45.551028 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.550997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.552403 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.552383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" Jun 11 18:37:45.555376 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.555350 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:37:45.557847 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.557828 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.563664 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.563619 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rsm52\"" Jun 11 18:37:45.563754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.563678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 18:37:45.563991 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.563972 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 18:37:45.564049 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.564000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 18:37:45.564257 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.564239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 18:37:45.564456 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.564437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 18:37:45.564763 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.564733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 18:37:45.564763 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.564749 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 18:37:45.565074 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.565052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 18:37:45.565176 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.565106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 18:37:45.585861 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.585831 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:37:45.644818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.644985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.644985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.644985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.644985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.644985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv7k2\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.644993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645112 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.645314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.645305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.714328 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:45.714296 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7aff3c8_48a2_4a6d_8c0d_dd1192d7e5e3.slice/crio-828fea643208f6727ebce8f7371ff0540478e9146e1f68d653278c6b3c7b6da5 WatchSource:0}: Error finding container 828fea643208f6727ebce8f7371ff0540478e9146e1f68d653278c6b3c7b6da5: Status 404 returned error can't find the container with id 828fea643208f6727ebce8f7371ff0540478e9146e1f68d653278c6b3c7b6da5 Jun 11 18:37:45.748229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv7k2\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748229 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748453 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748453 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748453 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748453 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748453 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748710 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748710 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748710 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.748710 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.749305 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.748967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.750201 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.750173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.750591 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:45.750570 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 18:37:45.750684 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:45.750671 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls podName:83cd6195-bb22-4a54-8eb9-589f7381aff1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:46.250629291 +0000 UTC m=+71.203431663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1") : secret "alertmanager-main-tls" not found Jun 11 18:37:45.751568 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:45.751548 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle podName:83cd6195-bb22-4a54-8eb9-589f7381aff1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:46.251532062 +0000 UTC m=+71.204334441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1") : configmap references non-existent config key: ca-bundle.crt Jun 11 18:37:45.752780 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.752732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.754128 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.754084 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.755264 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.755153 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.755357 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.755302 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.755466 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.755441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.755695 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.755672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.757749 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.757631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.758510 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.758471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.760944 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.760892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv7k2\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:45.862807 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.862786 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg"] Jun 11 18:37:45.865002 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:45.864970 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954c1a24_a429_4aab_99a9_9a91319cf4bf.slice/crio-30ede5a6e42c21ae8861dcb47f82fa5b24bd5db7a5fb951047ff2ad7281f986f WatchSource:0}: Error finding container 30ede5a6e42c21ae8861dcb47f82fa5b24bd5db7a5fb951047ff2ad7281f986f: Status 404 returned error can't find the container with id 30ede5a6e42c21ae8861dcb47f82fa5b24bd5db7a5fb951047ff2ad7281f986f Jun 11 18:37:45.882257 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.882196 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c"] Jun 11 18:37:45.884496 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:45.884472 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833cb9b5_10cb_412d_8fcd_f3280e0dd5b2.slice/crio-35ea5961534377ceaffb0d0a224cb162e2c0c6f6403243ffb6b5a32e0093b8e8 WatchSource:0}: Error finding container 35ea5961534377ceaffb0d0a224cb162e2c0c6f6403243ffb6b5a32e0093b8e8: Status 404 returned error can't find the container with id 35ea5961534377ceaffb0d0a224cb162e2c0c6f6403243ffb6b5a32e0093b8e8 Jun 11 18:37:45.886334 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.886309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.944455 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.944416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" event={"ID":"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2","Type":"ContainerStarted","Data":"35ea5961534377ceaffb0d0a224cb162e2c0c6f6403243ffb6b5a32e0093b8e8"} Jun 11 18:37:45.945971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.945943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x96t8" event={"ID":"24977f59-bbbd-46e6-8455-a65836976c6f","Type":"ContainerStarted","Data":"d967bd1f571217bfb0d5047e391e4fe82d6fbcb5fa73907edfa10601483c93b6"} Jun 11 18:37:45.947597 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.947571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv88l" event={"ID":"383447f3-5236-4207-8de9-69063a231aed","Type":"ContainerStarted","Data":"b96907cb043bdb6ff69d26731ad3a3fdff4e7966389b451be1ec569581e855f4"} Jun 11 18:37:45.947728 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.947678 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:37:45.949219 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.949149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qxqbn" event={"ID":"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3","Type":"ContainerStarted","Data":"828fea643208f6727ebce8f7371ff0540478e9146e1f68d653278c6b3c7b6da5"} Jun 11 18:37:45.950549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.950528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" event={"ID":"954c1a24-a429-4aab-99a9-9a91319cf4bf","Type":"ContainerStarted","Data":"30ede5a6e42c21ae8861dcb47f82fa5b24bd5db7a5fb951047ff2ad7281f986f"} Jun 11 18:37:45.961896 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.961823 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x96t8" podStartSLOduration=66.396603274 podStartE2EDuration="1m10.961809438s" totalImagesPullingTime="4.565206164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:45.961236162 +0000 UTC m=+70.914038556" watchObservedRunningTime="2026-06-11 18:37:45.961809438 +0000 UTC m=+70.914611832" Jun 11 18:37:45.977172 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:45.977123 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hv88l" podStartSLOduration=66.197320604 podStartE2EDuration="1m10.977104212s" totalImagesPullingTime="4.779783608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:45.976385346 +0000 UTC m=+70.929187764" watchObservedRunningTime="2026-06-11 18:37:45.977104212 +0000 UTC m=+70.929906606" Jun 11 18:37:46.024704 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.024675 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:46.094076 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.094035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:46.251933 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.251849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:46.251933 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.251894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:46.252120 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:46.252058 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle podName:83cd6195-bb22-4a54-8eb9-589f7381aff1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:47.252034662 +0000 UTC m=+72.204837047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1") : configmap references non-existent config key: ca-bundle.crt Jun 11 18:37:46.254829 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.254800 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:46.955839 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.955806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" event={"ID":"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2","Type":"ContainerStarted","Data":"6989b4071c067238d98fe19e3af06daf463461826e429327114aa972b92538e8"} Jun 11 18:37:46.956260 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:46.955866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" event={"ID":"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2","Type":"ContainerStarted","Data":"a019839b8ac41dffa5aa9dac6f0ea596f57baa0c0e8fd18b646d036608620f9b"} Jun 11 18:37:47.261520 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.261488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:47.261750 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:47.261731 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle podName:83cd6195-bb22-4a54-8eb9-589f7381aff1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:49.261705514 +0000 UTC m=+74.214507904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1") : configmap references non-existent config key: ca-bundle.crt Jun 11 18:37:47.527755 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.527713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.628728 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.628690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.731279 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.731250 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.806926 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.806855 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.881959 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.881929 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.960830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.960794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" event={"ID":"833cb9b5-10cb-412d-8fcd-f3280e0dd5b2","Type":"ContainerStarted","Data":"91b287e472e85fbdcf130004bcdfb957be1c4c42ba6574fe73effc4dfe0588e8"} Jun 11 18:37:47.962398 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.962368 2567 generic.go:356] "Generic (PLEG): container finished" podID="d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3" containerID="bebdccc8e9d9345ef11dc74fcc13997d855fb4d53a759b122404ab225b579d7e" exitCode=0 Jun 11 18:37:47.962523 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.962451 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qxqbn" event={"ID":"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3","Type":"ContainerDied","Data":"bebdccc8e9d9345ef11dc74fcc13997d855fb4d53a759b122404ab225b579d7e"} Jun 11 18:37:47.964710 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.964684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" event={"ID":"954c1a24-a429-4aab-99a9-9a91319cf4bf","Type":"ContainerStarted","Data":"8eeeb73bf83820d20b5906eb8561725d6187f26eac871c681f15af62205d459b"} Jun 11 18:37:47.964840 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.964737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" event={"ID":"954c1a24-a429-4aab-99a9-9a91319cf4bf","Type":"ContainerStarted","Data":"31f5f067367d9d53e58b9621d39c4420f986a5b2058bb6ba930432fd2f476d07"} Jun 11 18:37:47.964840 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.964766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" event={"ID":"954c1a24-a429-4aab-99a9-9a91319cf4bf","Type":"ContainerStarted","Data":"459a7584b2925de6018ac5e30ff81933e57858b89fe7c6895ace2d42951b6596"} Jun 11 18:37:47.983540 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:47.983500 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bxw6c" podStartSLOduration=2.8188107110000002 podStartE2EDuration="3.983482729s" totalImagesPullingTime="1.164672018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:47.982232895 +0000 UTC m=+72.935035289" watchObservedRunningTime="2026-06-11 18:37:47.983482729 +0000 UTC m=+72.936285122" Jun 11 18:37:48.004426 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.004345 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-z7lvg" podStartSLOduration=2.740551329 podStartE2EDuration="4.004325854s" totalImagesPullingTime="1.263774525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:48.003750106 +0000 UTC m=+72.956552516" watchObservedRunningTime="2026-06-11 18:37:48.004325854 +0000 UTC m=+72.957128254" Jun 11 18:37:48.118412 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.118385 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:48.909995 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.909963 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hv2ct" Jun 11 18:37:48.912560 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.912532 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78fd5df87b-2rnmm"] Jun 11 18:37:48.915494 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.915476 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:48.921164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.921135 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 18:37:48.922272 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.922244 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 18:37:48.922272 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.922267 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9b0kts8p88al1\"" Jun 11 18:37:48.922465 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.922312 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 18:37:48.922465 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.922330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zc7w6\"" Jun 11 18:37:48.922465 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.922331 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 18:37:48.928871 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.928851 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78fd5df87b-2rnmm"] Jun 11 18:37:48.971025 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.970989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qxqbn" event={"ID":"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3","Type":"ContainerStarted","Data":"b81f79dd430c24e6c84d9535b6bd7be27888e52d0277018a398d6208bca3ad8b"} Jun 11 18:37:48.971404 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.971051 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qxqbn" event={"ID":"d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3","Type":"ContainerStarted","Data":"354e156d34d4a8c8b2d5024cb1a6add660690460381694428157ac1ac6928c53"} Jun 11 18:37:48.997212 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:48.997164 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qxqbn" podStartSLOduration=3.508973608 podStartE2EDuration="4.997151242s" totalImagesPullingTime="1.411400251s" totalInitContainerRuntime="76.777383ms" isStatefulPod=true podCreationTimestamp="2026-06-11 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:48.996911773 +0000 UTC m=+73.949714188" watchObservedRunningTime="2026-06-11 18:37:48.997151242 +0000 UTC m=+73.949953636" Jun 11 18:37:49.078284 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078419 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7m9j\" (UniqueName: \"kubernetes.io/projected/e9f69181-02f4-495e-8e2b-8d97574ce6da-kube-api-access-f7m9j\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078541 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-client-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078783 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-client-certs\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-tls\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-metrics-server-audit-profiles\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.078956 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.078901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9f69181-02f4-495e-8e2b-8d97574ce6da-audit-log\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179743 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179831 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7m9j\" (UniqueName: \"kubernetes.io/projected/e9f69181-02f4-495e-8e2b-8d97574ce6da-kube-api-access-f7m9j\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179831 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-client-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-client-certs\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-tls\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.179914 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.179894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-metrics-server-audit-profiles\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.180082 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.180063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9f69181-02f4-495e-8e2b-8d97574ce6da-audit-log\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.180457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.180427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.180562 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.180433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9f69181-02f4-495e-8e2b-8d97574ce6da-audit-log\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.180826 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.180807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9f69181-02f4-495e-8e2b-8d97574ce6da-metrics-server-audit-profiles\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.182308 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.182281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-client-certs\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.182418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.182395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-secret-metrics-server-tls\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.182504 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.182487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f69181-02f4-495e-8e2b-8d97574ce6da-client-ca-bundle\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.193803 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.193785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7m9j\" (UniqueName: \"kubernetes.io/projected/e9f69181-02f4-495e-8e2b-8d97574ce6da-kube-api-access-f7m9j\") pod \"metrics-server-78fd5df87b-2rnmm\" (UID: \"e9f69181-02f4-495e-8e2b-8d97574ce6da\") " pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.227782 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.227764 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:37:49.280984 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.280794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:49.281114 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:49.281011 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle podName:83cd6195-bb22-4a54-8eb9-589f7381aff1 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:53.280987736 +0000 UTC m=+78.233790112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1") : configmap references non-existent config key: ca-bundle.crt Jun 11 18:37:49.289211 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.289175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:49.331931 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.331903 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-556pw"] Jun 11 18:37:49.336352 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.336329 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.339238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.339220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wmc66\"" Jun 11 18:37:49.339823 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.339802 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 18:37:49.351143 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.351120 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-556pw"] Jun 11 18:37:49.374553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.374424 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78fd5df87b-2rnmm"] Jun 11 18:37:49.376859 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:49.376835 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f69181_02f4_495e_8e2b_8d97574ce6da.slice/crio-605ed61e22c149600301ab5f65e477a995032b0eeaf64607ae8a39db40acde0e WatchSource:0}: Error finding container 605ed61e22c149600301ab5f65e477a995032b0eeaf64607ae8a39db40acde0e: Status 404 returned error can't find the container with id 605ed61e22c149600301ab5f65e477a995032b0eeaf64607ae8a39db40acde0e Jun 11 18:37:49.392294 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.392269 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:49.482328 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.482264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ce0994a-db2b-499d-b9a6-b1b19c163a21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.482328 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.482306 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnpv8\" (UniqueName: \"kubernetes.io/projected/5ce0994a-db2b-499d-b9a6-b1b19c163a21-kube-api-access-xnpv8\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.495262 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.495239 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:49.582968 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.582945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ce0994a-db2b-499d-b9a6-b1b19c163a21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.583084 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.582987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnpv8\" (UniqueName: \"kubernetes.io/projected/5ce0994a-db2b-499d-b9a6-b1b19c163a21-kube-api-access-xnpv8\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.585271 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.585243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ce0994a-db2b-499d-b9a6-b1b19c163a21-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.591194 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.591161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:49.591489 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.591471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnpv8\" (UniqueName: \"kubernetes.io/projected/5ce0994a-db2b-499d-b9a6-b1b19c163a21-kube-api-access-xnpv8\") pod \"monitoring-plugin-589576dfc7-556pw\" (UID: \"5ce0994a-db2b-499d-b9a6-b1b19c163a21\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.645896 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.645873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:49.786308 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.786281 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-556pw"] Jun 11 18:37:49.788894 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:49.788864 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce0994a_db2b_499d_b9a6_b1b19c163a21.slice/crio-d297ed8b7081bae4c7b4678c085702242f235fb15f0ba38482605795fdd91f3f WatchSource:0}: Error finding container d297ed8b7081bae4c7b4678c085702242f235fb15f0ba38482605795fdd91f3f: Status 404 returned error can't find the container with id d297ed8b7081bae4c7b4678c085702242f235fb15f0ba38482605795fdd91f3f Jun 11 18:37:49.976329 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.976298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" event={"ID":"5ce0994a-db2b-499d-b9a6-b1b19c163a21","Type":"ContainerStarted","Data":"d297ed8b7081bae4c7b4678c085702242f235fb15f0ba38482605795fdd91f3f"} Jun 11 18:37:49.977445 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:49.977420 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" event={"ID":"e9f69181-02f4-495e-8e2b-8d97574ce6da","Type":"ContainerStarted","Data":"605ed61e22c149600301ab5f65e477a995032b0eeaf64607ae8a39db40acde0e"} Jun 11 18:37:50.842764 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.842735 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:37:50.846742 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.846708 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:50.847046 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.847024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.852664 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.852631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 18:37:50.852957 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.852928 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 18:37:50.853053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853008 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9mvf8\"" Jun 11 18:37:50.853125 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 18:37:50.853125 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853105 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 18:37:50.853830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1lvk1mf040cpv\"" Jun 11 18:37:50.853830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853829 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 18:37:50.853985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853820 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 18:37:50.853985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853931 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 18:37:50.853985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.853842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 18:37:50.854130 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.854056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 18:37:50.854194 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.854176 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 18:37:50.854194 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.854189 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 18:37:50.854307 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.854241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 18:37:50.855367 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.855343 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 18:37:50.859474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.859450 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 18:37:50.869333 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.869311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:37:50.982731 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.982697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" event={"ID":"e9f69181-02f4-495e-8e2b-8d97574ce6da","Type":"ContainerStarted","Data":"c51186ae675bec4132e7c86debfb1716eaea626f5159aafe63819f09a6833596"} Jun 11 18:37:50.996631 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.996791 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.996791 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.996791 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.996791 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.996944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:50.997311 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:50.997279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25kk8\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.002662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.002603 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" podStartSLOduration=1.4853532839999999 podStartE2EDuration="3.002589128s" totalImagesPullingTime="1.517235844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:51.001882192 +0000 UTC m=+75.954684612" watchObservedRunningTime="2026-06-11 18:37:51.002589128 +0000 UTC m=+75.955391523" Jun 11 18:37:51.098402 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098567 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25kk8\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098567 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098567 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098908 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098908 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:37:51.098818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle podName:8f61b8ba-1d02-4d33-807f-e4e4cbb28726 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:51.598795118 +0000 UTC m=+76.551597489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726") : configmap references non-existent config key: ca-bundle.crt Jun 11 18:37:51.098908 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.098908 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.098980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099112 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099407 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099601 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.099928 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.099875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.100155 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.100135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.100230 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.100182 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.102669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.101418 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.102669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.101586 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.102669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.102008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.102899 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.102771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.104633 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.104588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.104740 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.104671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105111 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105190 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105359 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.105897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.105891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.106160 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.106135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.107992 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.107962 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.109258 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.109220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25kk8\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.602920 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.602884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.603617 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.603595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.760467 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.760381 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:37:51.897617 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.897592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:37:51.899571 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:51.899536 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f61b8ba_1d02_4d33_807f_e4e4cbb28726.slice/crio-393c39e5928d4ae8032ebdf6906d281f46284d0fc6512ee4ce82e22d67e1e1b0 WatchSource:0}: Error finding container 393c39e5928d4ae8032ebdf6906d281f46284d0fc6512ee4ce82e22d67e1e1b0: Status 404 returned error can't find the container with id 393c39e5928d4ae8032ebdf6906d281f46284d0fc6512ee4ce82e22d67e1e1b0 Jun 11 18:37:51.987796 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.987765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"393c39e5928d4ae8032ebdf6906d281f46284d0fc6512ee4ce82e22d67e1e1b0"} Jun 11 18:37:51.989382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:51.989350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" event={"ID":"5ce0994a-db2b-499d-b9a6-b1b19c163a21","Type":"ContainerStarted","Data":"d8e338730fb908f999c8255650f2b906066b68aac9ecb7f67fd0ee14328ab21e"} Jun 11 18:37:52.015724 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:52.015671 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" podStartSLOduration=1.428609971 podStartE2EDuration="3.015628413s" totalImagesPullingTime="1.587018442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:52.014497029 +0000 UTC m=+76.967299424" watchObservedRunningTime="2026-06-11 18:37:52.015628413 +0000 UTC m=+76.968430807" Jun 11 18:37:52.993895 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:52.993869 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" exitCode=0 Jun 11 18:37:52.994209 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:52.993952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} Jun 11 18:37:52.994257 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:52.994213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:52.999401 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:52.999383 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-556pw" Jun 11 18:37:53.317717 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:53.317690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:53.318395 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:53.318374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:53.372097 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:53.372066 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:37:53.505109 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:53.505088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:37:53.507459 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:37:53.507420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83cd6195_bb22_4a54_8eb9_589f7381aff1.slice/crio-da2b7007e1675fb1b8ad1547f8a440558599de15b6d9f21a0cd17df5e23e8f2e WatchSource:0}: Error finding container da2b7007e1675fb1b8ad1547f8a440558599de15b6d9f21a0cd17df5e23e8f2e: Status 404 returned error can't find the container with id da2b7007e1675fb1b8ad1547f8a440558599de15b6d9f21a0cd17df5e23e8f2e Jun 11 18:37:54.000230 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:54.000073 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d" exitCode=0 Jun 11 18:37:54.000230 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:54.000167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d"} Jun 11 18:37:54.000695 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:54.000282 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"da2b7007e1675fb1b8ad1547f8a440558599de15b6d9f21a0cd17df5e23e8f2e"} Jun 11 18:37:56.013138 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.013095 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690"} Jun 11 18:37:56.013625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.013188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15"} Jun 11 18:37:56.013625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.013230 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa"} Jun 11 18:37:56.013625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.013279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063"} Jun 11 18:37:56.013625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.013381 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e"} Jun 11 18:37:56.125702 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.125665 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:56.225403 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:56.225380 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:57.023054 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:57.023018 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerStarted","Data":"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada"} Jun 11 18:37:57.051827 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:57.051759 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.176667005 podStartE2EDuration="12.051741414s" totalImagesPullingTime="1.857861772s" totalInitContainerRuntime="17.212637ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:57.050263849 +0000 UTC m=+82.003066243" watchObservedRunningTime="2026-06-11 18:37:57.051741414 +0000 UTC m=+82.004543808" Jun 11 18:37:57.885795 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:57.885763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:57.984730 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:57.984695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.032354 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.032323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} Jun 11 18:37:58.032817 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.032424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} Jun 11 18:37:58.043437 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.043409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.294061 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.294016 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.364667 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.364618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.420137 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.420106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.800530 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.800489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.899962 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:37:58.899924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:00.043873 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:00.043834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} Jun 11 18:38:00.044347 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:00.043910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} Jun 11 18:38:00.044347 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:00.043947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} Jun 11 18:38:00.044347 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:00.043992 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerStarted","Data":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} Jun 11 18:38:00.081321 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:00.081261 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.033546803 podStartE2EDuration="10.08123165s" totalImagesPullingTime="7.029429804s" totalInitContainerRuntime="18.255043ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:00.079582505 +0000 UTC m=+85.032384921" watchObservedRunningTime="2026-06-11 18:38:00.08123165 +0000 UTC m=+85.034034046" Jun 11 18:38:01.029676 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:01.029627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:01.129805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:01.129769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:01.760662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:01.760623 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:38:09.030693 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:09.030640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:09.085147 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:09.085114 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:09.148123 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:09.148098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:09.228147 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:09.228116 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:38:09.228296 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:09.228202 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:38:15.845004 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:15.844970 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:15.893291 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:15.893259 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:16.043241 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:16.043196 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:16.142845 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:16.142762 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:16.958263 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:16.958234 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hv88l" Jun 11 18:38:29.233164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:29.233135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:38:29.236920 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:29.236899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78fd5df87b-2rnmm" Jun 11 18:38:51.760991 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:51.760956 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:38:51.779872 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:51.779847 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:38:52.249426 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:52.249401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:38:55.097837 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:38:55.097792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:00.695921 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:00.695886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:00.747089 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:00.747052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:04.963168 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963132 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:04.963684 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963466 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="alertmanager" containerID="cri-o://4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e" gracePeriod=120 Jun 11 18:39:04.963684 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963516 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="prom-label-proxy" containerID="cri-o://d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada" gracePeriod=120 Jun 11 18:39:04.963837 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963760 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-web" containerID="cri-o://ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa" gracePeriod=120 Jun 11 18:39:04.963837 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963787 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-metric" containerID="cri-o://26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690" gracePeriod=120 Jun 11 18:39:04.963985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963936 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="config-reloader" containerID="cri-o://14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063" gracePeriod=120 Jun 11 18:39:04.964118 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:04.963999 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy" containerID="cri-o://0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15" gracePeriod=120 Jun 11 18:39:05.283766 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283737 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada" exitCode=0 Jun 11 18:39:05.283766 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283762 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690" exitCode=0 Jun 11 18:39:05.283766 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283771 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15" exitCode=0 Jun 11 18:39:05.283766 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283778 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063" exitCode=0 Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283786 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e" exitCode=0 Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada"} Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690"} Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283898 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15"} Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283923 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063"} Jun 11 18:39:05.284029 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:05.283947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e"} Jun 11 18:39:06.200409 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.200387 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.218388 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218367 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218412 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218440 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218462 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218618 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218480 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218618 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218506 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218618 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218543 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218618 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218582 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218844 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218620 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv7k2\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218844 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218671 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218844 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218704 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.218844 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218752 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.219041 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.218835 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:06.219041 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.219015 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-main-db\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.219238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.219161 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:06.219595 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.219559 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:06.221632 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.221603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.222057 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222028 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume" (OuterVolumeSpecName: "config-volume") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.222298 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222260 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.222400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222364 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.222481 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222458 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out" (OuterVolumeSpecName: "config-out") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:06.222528 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222491 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:06.222835 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.222801 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2" (OuterVolumeSpecName: "kube-api-access-hv7k2") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "kube-api-access-hv7k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:06.226380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.226236 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.236694 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.236290 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config" (OuterVolumeSpecName: "web-config") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.291057 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.290983 2567 generic.go:356] "Generic (PLEG): container finished" podID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerID="ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa" exitCode=0 Jun 11 18:39:06.291057 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.291031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa"} Jun 11 18:39:06.291199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.291056 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.291199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.291087 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83cd6195-bb22-4a54-8eb9-589f7381aff1","Type":"ContainerDied","Data":"da2b7007e1675fb1b8ad1547f8a440558599de15b6d9f21a0cd17df5e23e8f2e"} Jun 11 18:39:06.291199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.291120 2567 scope.go:117] "RemoveContainer" containerID="d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada" Jun 11 18:39:06.298378 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.298364 2567 scope.go:117] "RemoveContainer" containerID="26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690" Jun 11 18:39:06.304808 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.304794 2567 scope.go:117] "RemoveContainer" containerID="0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15" Jun 11 18:39:06.310972 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.310958 2567 scope.go:117] "RemoveContainer" containerID="ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa" Jun 11 18:39:06.317183 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.317167 2567 scope.go:117] "RemoveContainer" containerID="14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063" Jun 11 18:39:06.319287 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319270 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy\") pod \"83cd6195-bb22-4a54-8eb9-589f7381aff1\" (UID: \"83cd6195-bb22-4a54-8eb9-589f7381aff1\") " Jun 11 18:39:06.319391 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319379 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-out\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319430 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319393 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-config-volume\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319430 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319401 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-web-config\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319430 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319410 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-main-tls\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319430 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319420 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-tls-assets\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319429 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319439 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-cluster-tls-config\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319449 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319458 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv7k2\" (UniqueName: \"kubernetes.io/projected/83cd6195-bb22-4a54-8eb9-589f7381aff1-kube-api-access-hv7k2\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319466 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-metrics-client-ca\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.319555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.319475 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83cd6195-bb22-4a54-8eb9-589f7381aff1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.321225 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.321203 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "83cd6195-bb22-4a54-8eb9-589f7381aff1" (UID: "83cd6195-bb22-4a54-8eb9-589f7381aff1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:06.323719 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.323702 2567 scope.go:117] "RemoveContainer" containerID="4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e" Jun 11 18:39:06.330166 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.330151 2567 scope.go:117] "RemoveContainer" containerID="a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d" Jun 11 18:39:06.336466 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.336451 2567 scope.go:117] "RemoveContainer" containerID="d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada" Jun 11 18:39:06.336812 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.336792 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada\": container with ID starting with d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada not found: ID does not exist" containerID="d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada" Jun 11 18:39:06.336868 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.336823 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada"} err="failed to get container status \"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada\": rpc error: code = NotFound desc = could not find container \"d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada\": container with ID starting with d4e99a9fb3aba3b3b1b9d81f7cc3d5adae4ab991f642756afbfcf1aa7a7d8ada not found: ID does not exist" Jun 11 18:39:06.336868 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.336854 2567 scope.go:117] "RemoveContainer" containerID="26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690" Jun 11 18:39:06.337053 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.337035 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690\": container with ID starting with 26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690 not found: ID does not exist" containerID="26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690" Jun 11 18:39:06.337088 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337059 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690"} err="failed to get container status \"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690\": rpc error: code = NotFound desc = could not find container \"26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690\": container with ID starting with 26e655577031025d024089b9dc63d917998dfc2a5790c4e1340e642bf7c85690 not found: ID does not exist" Jun 11 18:39:06.337088 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337071 2567 scope.go:117] "RemoveContainer" containerID="0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15" Jun 11 18:39:06.337269 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.337253 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15\": container with ID starting with 0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15 not found: ID does not exist" containerID="0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15" Jun 11 18:39:06.337307 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337274 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15"} err="failed to get container status \"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15\": rpc error: code = NotFound desc = could not find container \"0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15\": container with ID starting with 0302a6cb203c65db8daf98ea7a1f8408982b38e5722df9027ca57971d492ed15 not found: ID does not exist" Jun 11 18:39:06.337307 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337290 2567 scope.go:117] "RemoveContainer" containerID="ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa" Jun 11 18:39:06.337473 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.337457 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa\": container with ID starting with ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa not found: ID does not exist" containerID="ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa" Jun 11 18:39:06.337514 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337473 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa"} err="failed to get container status \"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa\": rpc error: code = NotFound desc = could not find container \"ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa\": container with ID starting with ba6b8a23c81724cbe71b78cee9b8174cf96c4d543db6d45ee0d69f8cfeff2ffa not found: ID does not exist" Jun 11 18:39:06.337514 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337484 2567 scope.go:117] "RemoveContainer" containerID="14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063" Jun 11 18:39:06.337687 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.337673 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063\": container with ID starting with 14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063 not found: ID does not exist" containerID="14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063" Jun 11 18:39:06.337732 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337688 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063"} err="failed to get container status \"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063\": rpc error: code = NotFound desc = could not find container \"14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063\": container with ID starting with 14b9da3b5b87f41f7fb2e8d9347b92dfdae313c1a180f1afe48e5ebf71015063 not found: ID does not exist" Jun 11 18:39:06.337732 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337699 2567 scope.go:117] "RemoveContainer" containerID="4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e" Jun 11 18:39:06.337924 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.337909 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e\": container with ID starting with 4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e not found: ID does not exist" containerID="4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e" Jun 11 18:39:06.337979 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337926 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e"} err="failed to get container status \"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e\": rpc error: code = NotFound desc = could not find container \"4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e\": container with ID starting with 4fb560e81e10641dce3a20dc2c8c0be16cec1399f3e9226d1bafedf1bf14e61e not found: ID does not exist" Jun 11 18:39:06.337979 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.337939 2567 scope.go:117] "RemoveContainer" containerID="a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d" Jun 11 18:39:06.338109 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:06.338096 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d\": container with ID starting with a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d not found: ID does not exist" containerID="a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d" Jun 11 18:39:06.338147 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.338112 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d"} err="failed to get container status \"a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d\": rpc error: code = NotFound desc = could not find container \"a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d\": container with ID starting with a6bf2d8b4ac906ca586cad4d64bf7a783bd714f140b633aeb9a0e959feebae7d not found: ID does not exist" Jun 11 18:39:06.420702 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.420671 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83cd6195-bb22-4a54-8eb9-589f7381aff1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:06.616373 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.616338 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:06.619871 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:06.619848 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:07.456237 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:07.456148 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" path="/var/lib/kubelet/pods/83cd6195-bb22-4a54-8eb9-589f7381aff1/volumes" Jun 11 18:39:09.221014 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.220959 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:09.221463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221346 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="prometheus" containerID="cri-o://837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" gracePeriod=600 Jun 11 18:39:09.221463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221373 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy" containerID="cri-o://6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" gracePeriod=600 Jun 11 18:39:09.221463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221430 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="config-reloader" containerID="cri-o://5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" gracePeriod=600 Jun 11 18:39:09.221629 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221387 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="thanos-sidecar" containerID="cri-o://6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" gracePeriod=600 Jun 11 18:39:09.221629 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221496 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-thanos" containerID="cri-o://38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" gracePeriod=600 Jun 11 18:39:09.221629 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.221437 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-web" containerID="cri-o://07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" gracePeriod=600 Jun 11 18:39:09.453731 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.453708 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:09.488522 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.488452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:09.543853 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.543825 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544024 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.543867 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544024 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.543886 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544024 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.543907 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544024 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.543963 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544237 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544129 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544237 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544179 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544237 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544223 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544254 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544284 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544285 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544309 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544322 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544342 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544382 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544382 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544410 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544436 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544476 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544505 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544534 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544563 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25kk8\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544600 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2\") pod \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\" (UID: \"8f61b8ba-1d02-4d33-807f-e4e4cbb28726\") " Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544712 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.544751 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544730 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.545164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.544986 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.545164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.545005 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.545164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.545021 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-metrics-client-ca\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.545164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.545037 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.545811 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.545785 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.546782 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.546072 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:09.546782 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.546194 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.546782 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.546225 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:09.547343 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.547303 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out" (OuterVolumeSpecName: "config-out") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:09.547675 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.547536 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.547675 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.547564 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.547675 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.547581 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8" (OuterVolumeSpecName: "kube-api-access-25kk8") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "kube-api-access-25kk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:09.547675 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.547626 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.548418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.548385 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:09.548559 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.548532 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config" (OuterVolumeSpecName: "config") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.548664 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.548625 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.549297 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.549279 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.549507 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.549481 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.549841 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.549821 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.557050 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.557022 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config" (OuterVolumeSpecName: "web-config") pod "8f61b8ba-1d02-4d33-807f-e4e4cbb28726" (UID: "8f61b8ba-1d02-4d33-807f-e4e4cbb28726"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:09.614320 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.614295 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:09.646118 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646097 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646118 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646116 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646128 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-kube-rbac-proxy\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646137 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-web-config\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646148 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646156 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-metrics-client-certs\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646164 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-grpc-tls\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646172 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646180 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646189 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646198 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-db\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646206 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config-out\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646213 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-config\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646220 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-tls-assets\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646228 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25kk8\" (UniqueName: \"kubernetes.io/projected/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-kube-api-access-25kk8\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:09.646579 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:09.646237 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f61b8ba-1d02-4d33-807f-e4e4cbb28726-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:39:10.308713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308684 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" exitCode=0 Jun 11 18:39:10.308713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308707 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" exitCode=0 Jun 11 18:39:10.308713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308713 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" exitCode=0 Jun 11 18:39:10.308713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308719 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" exitCode=0 Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308726 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" exitCode=0 Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308731 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" exitCode=0 Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308763 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308845 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308911 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308927 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.308973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.309014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} Jun 11 18:39:10.309164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.309055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f61b8ba-1d02-4d33-807f-e4e4cbb28726","Type":"ContainerDied","Data":"393c39e5928d4ae8032ebdf6906d281f46284d0fc6512ee4ce82e22d67e1e1b0"} Jun 11 18:39:10.316641 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.316625 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.323124 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.323106 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.329348 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.329324 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.332218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.332196 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:10.336600 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.336564 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.340672 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.337516 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:10.346452 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.346432 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.353218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.353200 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.359748 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.359728 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.360016 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.359998 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.360064 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360026 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.360064 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360045 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.360261 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.360244 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.360307 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360265 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.360307 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360278 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.360455 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.360441 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.360496 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360457 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.360496 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360467 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.360701 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.360683 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.360762 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360710 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.360762 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360731 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.360973 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.360956 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.361014 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360978 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.361014 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.360992 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.361241 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.361223 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.361291 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361245 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.361291 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361260 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.361487 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:39:10.361474 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.361535 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361490 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.361535 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361501 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.361750 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361734 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.361750 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361750 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.361954 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361941 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.362000 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.361954 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.362138 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362122 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.362181 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362138 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.362370 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362348 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.362370 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362377 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.362800 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362762 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.362800 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.362789 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.363079 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363053 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.363079 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363079 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.363444 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363331 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.363444 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363357 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.363723 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363688 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.363810 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363725 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.364014 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.363994 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.364083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364016 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.364240 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364224 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.364315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364241 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.364422 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364407 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:10.364488 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364431 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.364488 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364451 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.364711 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364689 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364709 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-thanos" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364724 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-thanos" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364734 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="init-config-reloader" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364739 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="init-config-reloader" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364747 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="thanos-sidecar" Jun 11 18:39:10.364754 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364752 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="thanos-sidecar" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364759 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="prom-label-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364765 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="prom-label-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364775 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364712 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364784 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364793 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-metric" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364801 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-metric" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364809 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364817 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364827 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364835 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364846 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364852 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364860 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="prometheus" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364866 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="prometheus" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364871 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364876 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364884 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="init-config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364889 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="init-config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364895 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="alertmanager" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364900 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="alertmanager" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364905 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364910 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="config-reloader" Jun 11 18:39:10.364958 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364966 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-metric" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364974 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="prometheus" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364980 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364985 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="prom-label-proxy" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364992 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="config-reloader" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.364999 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365004 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365010 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="kube-rbac-proxy-thanos" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365016 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="alertmanager" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365021 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" containerName="thanos-sidecar" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365026 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="config-reloader" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365023 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365046 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365032 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cd6195-bb22-4a54-8eb9-589f7381aff1" containerName="kube-rbac-proxy-web" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365288 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365305 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365531 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365548 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365787 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.365818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.365802 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366001 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366016 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366239 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366255 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366451 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.366468 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366467 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.366737 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366689 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.366737 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366704 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.366971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366919 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.366971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.366938 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.367179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367156 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.367242 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367179 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.367408 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367382 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.367408 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367404 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.367657 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367627 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.367717 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367660 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.367880 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367863 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.367917 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.367881 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.368097 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368076 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.368097 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368095 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.368298 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368280 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.368363 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368300 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.368523 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368506 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.368573 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368524 2567 scope.go:117] "RemoveContainer" containerID="38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e" Jun 11 18:39:10.368760 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368739 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e"} err="failed to get container status \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": rpc error: code = NotFound desc = could not find container \"38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e\": container with ID starting with 38a43e9d61bac43d0bd8a7a0726534c3dd5755f32894f832035ec5dc0d1d741e not found: ID does not exist" Jun 11 18:39:10.368805 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368762 2567 scope.go:117] "RemoveContainer" containerID="6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0" Jun 11 18:39:10.368942 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368923 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0"} err="failed to get container status \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": rpc error: code = NotFound desc = could not find container \"6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0\": container with ID starting with 6a29ce3383c1f277ae877425fb029cb6c1a5289e4704c2cfe7d1fbdac5e0cac0 not found: ID does not exist" Jun 11 18:39:10.369008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.368944 2567 scope.go:117] "RemoveContainer" containerID="07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef" Jun 11 18:39:10.369046 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.369375 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369196 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef"} err="failed to get container status \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": rpc error: code = NotFound desc = could not find container \"07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef\": container with ID starting with 07f86a283e5a0f910c9d754f01dbd095065487f336e33d493487a37ece0781ef not found: ID does not exist" Jun 11 18:39:10.369375 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369220 2567 scope.go:117] "RemoveContainer" containerID="6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12" Jun 11 18:39:10.369602 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369573 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12"} err="failed to get container status \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": rpc error: code = NotFound desc = could not find container \"6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12\": container with ID starting with 6d99fcf01c08d18585ece439dacd85bb03d7696b9675a7874c5313e237a6aa12 not found: ID does not exist" Jun 11 18:39:10.369602 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369599 2567 scope.go:117] "RemoveContainer" containerID="5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376" Jun 11 18:39:10.369878 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369856 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376"} err="failed to get container status \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": rpc error: code = NotFound desc = could not find container \"5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376\": container with ID starting with 5a63e7fde00bab7359587d0f02f43733f80a9a21bc8c7e268c41220c3ac90376 not found: ID does not exist" Jun 11 18:39:10.369878 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.369875 2567 scope.go:117] "RemoveContainer" containerID="837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df" Jun 11 18:39:10.370117 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.370097 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df"} err="failed to get container status \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": rpc error: code = NotFound desc = could not find container \"837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df\": container with ID starting with 837e722449afcb5de9f0353384ba9d5c6be324ecdd024e65ad89b5860e0703df not found: ID does not exist" Jun 11 18:39:10.370117 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.370117 2567 scope.go:117] "RemoveContainer" containerID="211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d" Jun 11 18:39:10.370325 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.370304 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d"} err="failed to get container status \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": rpc error: code = NotFound desc = could not find container \"211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d\": container with ID starting with 211923eac3408792b203d3f3f0118bbfb58bbe63b41be6beafa11949a9781d7d not found: ID does not exist" Jun 11 18:39:10.371850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 18:39:10.371937 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371836 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 18:39:10.371937 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371875 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 18:39:10.372069 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371941 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 18:39:10.372069 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371945 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 18:39:10.372069 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.371986 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 18:39:10.372256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1lvk1mf040cpv\"" Jun 11 18:39:10.372256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372128 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9mvf8\"" Jun 11 18:39:10.372256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372200 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 18:39:10.372256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 18:39:10.372705 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372690 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 18:39:10.372865 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372844 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 18:39:10.372974 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.372959 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 18:39:10.373095 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.373078 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 18:39:10.374807 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.374757 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 18:39:10.378201 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.378185 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 18:39:10.391233 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.391210 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:10.451818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.451981 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.451986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452248 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22dgh\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-kube-api-access-22dgh\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.452472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.452309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.552927 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.552896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.552956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.552987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553193 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553193 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553193 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22dgh\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-kube-api-access-22dgh\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553545 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.553545 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.553880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.554539 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.555109 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.554673 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.556360 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.556360 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556235 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.556509 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.556962 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557730 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.557452 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557730 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.557552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.557730 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.557683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.558915 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.558892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.559099 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.559080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.559179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.559160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a37e5af8-1491-44c7-a777-cac7a4dfb05a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.559224 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.559192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a37e5af8-1491-44c7-a777-cac7a4dfb05a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.562685 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.562670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22dgh\" (UniqueName: \"kubernetes.io/projected/a37e5af8-1491-44c7-a777-cac7a4dfb05a-kube-api-access-22dgh\") pod \"prometheus-k8s-0\" (UID: \"a37e5af8-1491-44c7-a777-cac7a4dfb05a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.678954 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.678900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:10.810873 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:10.810804 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:39:10.814024 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:39:10.813996 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37e5af8_1491_44c7_a777_cac7a4dfb05a.slice/crio-6aef3b0ad5dba6e742c2c12722208d890a490aca3743a2db2941900c360984af WatchSource:0}: Error finding container 6aef3b0ad5dba6e742c2c12722208d890a490aca3743a2db2941900c360984af: Status 404 returned error can't find the container with id 6aef3b0ad5dba6e742c2c12722208d890a490aca3743a2db2941900c360984af Jun 11 18:39:11.313285 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:11.313249 2567 generic.go:356] "Generic (PLEG): container finished" podID="a37e5af8-1491-44c7-a777-cac7a4dfb05a" containerID="29bcab110ccb92abfe6446ac4aa69cecd265241809472696cbc236ee761e7319" exitCode=0 Jun 11 18:39:11.313718 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:11.313342 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerDied","Data":"29bcab110ccb92abfe6446ac4aa69cecd265241809472696cbc236ee761e7319"} Jun 11 18:39:11.313718 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:11.313411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"6aef3b0ad5dba6e742c2c12722208d890a490aca3743a2db2941900c360984af"} Jun 11 18:39:11.456826 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:11.456790 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f61b8ba-1d02-4d33-807f-e4e4cbb28726" path="/var/lib/kubelet/pods/8f61b8ba-1d02-4d33-807f-e4e4cbb28726/volumes" Jun 11 18:39:12.321584 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"dd1ea80fc0ad61c48d7001a89ffd47ceb9627e82f2ecf41cbd7a5906f17c2e09"} Jun 11 18:39:12.321973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321642 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"fa135162eddaee4ce9c046df490d3de1d304c1c4302e786a920c42e664c861c8"} Jun 11 18:39:12.321973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"92a36b32926107d58805649793a63676869fd9ce54d2e7562bf4c25053b9a522"} Jun 11 18:39:12.321973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"2c5ca78e9dc61bc1275d245303f0eb170142677d5d0fd0f5d9430218168b0efb"} Jun 11 18:39:12.321973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"91673920981bd5a34f49bacca56518c519469706cb6fa3ff41738a5af3bc6010"} Jun 11 18:39:12.321973 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.321752 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a37e5af8-1491-44c7-a777-cac7a4dfb05a","Type":"ContainerStarted","Data":"1175cea8d9de6c2f947dd4be96d00ff70ec3fd7f964000fdac6d2da9ec893251"} Jun 11 18:39:12.350780 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.350482 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.334201384 podStartE2EDuration="2.350464536s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.263152ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:12.348517678 +0000 UTC m=+157.301320072" watchObservedRunningTime="2026-06-11 18:39:12.350464536 +0000 UTC m=+157.303266932" Jun 11 18:39:12.564538 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.564507 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:12.617145 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:12.617069 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:15.679774 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:15.679729 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:39:16.034513 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:16.034481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:16.134288 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:16.134254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:20.298732 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:20.298701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:20.399209 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:20.399176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:20.460603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:39:20.460580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:10.679350 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:10.679301 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:40:10.694564 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:10.694538 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:40:11.536087 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:11.536062 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:40:13.205463 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:13.205436 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:15.572889 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:15.572844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:15.664694 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:15.664658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:38.166452 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:38.166409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:41.950498 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:41.950452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:43.392800 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:43.392765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:45.551970 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:45.551933 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:45.607225 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:45.607190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:47.247915 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:47.247878 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:47.343541 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:47.343504 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:47.938625 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:47.938593 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:48.042615 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:48.042588 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:50.546262 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.546230 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:50.830716 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.830616 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs"] Jun 11 18:40:50.833957 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.833921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:50.836826 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.836805 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r5cm6\"" Jun 11 18:40:50.836935 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.836823 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 18:40:50.837993 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.837974 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 18:40:50.842606 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.842581 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs"] Jun 11 18:40:50.893640 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.893609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmdk\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-kube-api-access-2zmdk\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:50.893797 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.893687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:50.994584 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.994553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmdk\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-kube-api-access-2zmdk\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:50.994753 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:50.994607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:51.003827 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.003796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:51.003927 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.003887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmdk\" (UniqueName: \"kubernetes.io/projected/f037cc6a-27a4-4853-96ff-e51dcbb4e673-kube-api-access-2zmdk\") pod \"cert-manager-cainjector-5d99449ffd-fhcbs\" (UID: \"f037cc6a-27a4-4853-96ff-e51dcbb4e673\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:51.135439 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.135353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:51.154319 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.154285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" Jun 11 18:40:51.278179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.278143 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs"] Jun 11 18:40:51.281195 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:40:51.281164 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf037cc6a_27a4_4853_96ff_e51dcbb4e673.slice/crio-62361cfb45661dfffd73d98ec5d68d96bcf757b4dcc8a40bec3d412c6f19f19f WatchSource:0}: Error finding container 62361cfb45661dfffd73d98ec5d68d96bcf757b4dcc8a40bec3d412c6f19f19f: Status 404 returned error can't find the container with id 62361cfb45661dfffd73d98ec5d68d96bcf757b4dcc8a40bec3d412c6f19f19f Jun 11 18:40:51.659487 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:51.659448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" event={"ID":"f037cc6a-27a4-4853-96ff-e51dcbb4e673","Type":"ContainerStarted","Data":"62361cfb45661dfffd73d98ec5d68d96bcf757b4dcc8a40bec3d412c6f19f19f"} Jun 11 18:40:52.546617 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:52.546584 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:52.647907 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:52.647862 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:55.677759 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:55.677720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" event={"ID":"f037cc6a-27a4-4853-96ff-e51dcbb4e673","Type":"ContainerStarted","Data":"0c72c076547cb9f497caafcbd170fc58d2d558fc192049eaf8e358947412663f"} Jun 11 18:40:55.693220 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:55.693164 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fhcbs" podStartSLOduration=2.172494246 podStartE2EDuration="5.693144668s" totalImagesPullingTime="3.520650422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:55.69291384 +0000 UTC m=+260.645716235" watchObservedRunningTime="2026-06-11 18:40:55.693144668 +0000 UTC m=+260.645947064" Jun 11 18:40:56.506683 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:56.506626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:56.605821 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:56.605769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:58.361781 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:58.361749 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:58.463343 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:58.463310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:58.944272 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:40:58.944243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:05.237791 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:05.237746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:06.220293 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:06.220254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:07.307359 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:07.307325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:08.120664 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.120609 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fmmvs"] Jun 11 18:41:08.122937 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.122921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.127315 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.127299 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vkxvj\"" Jun 11 18:41:08.138839 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.138811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fmmvs"] Jun 11 18:41:08.242107 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.242073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-bound-sa-token\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.242107 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.242108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblsn\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-kube-api-access-lblsn\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.342986 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.342954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-bound-sa-token\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.343310 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.342991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lblsn\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-kube-api-access-lblsn\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.352691 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.352637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-bound-sa-token\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.352799 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.352788 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblsn\" (UniqueName: \"kubernetes.io/projected/14322b75-f0e7-40af-ae49-726907c480bc-kube-api-access-lblsn\") pod \"cert-manager-59c77684cc-fmmvs\" (UID: \"14322b75-f0e7-40af-ae49-726907c480bc\") " pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.431414 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.431342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fmmvs" Jun 11 18:41:08.553603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.553580 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fmmvs"] Jun 11 18:41:08.555866 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:41:08.555841 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14322b75_f0e7_40af_ae49_726907c480bc.slice/crio-5601b809d7034fcfc91ab36e1d6e8ee1878e4e36ac9fc8b71d59507b29b3645a WatchSource:0}: Error finding container 5601b809d7034fcfc91ab36e1d6e8ee1878e4e36ac9fc8b71d59507b29b3645a: Status 404 returned error can't find the container with id 5601b809d7034fcfc91ab36e1d6e8ee1878e4e36ac9fc8b71d59507b29b3645a Jun 11 18:41:08.730230 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.730143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fmmvs" event={"ID":"14322b75-f0e7-40af-ae49-726907c480bc","Type":"ContainerStarted","Data":"28b55e571272f43227412c1657788dc72d230d09b11b2c0aa1353f92bf7f6b6b"} Jun 11 18:41:08.730230 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.730186 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fmmvs" event={"ID":"14322b75-f0e7-40af-ae49-726907c480bc","Type":"ContainerStarted","Data":"5601b809d7034fcfc91ab36e1d6e8ee1878e4e36ac9fc8b71d59507b29b3645a"} Jun 11 18:41:08.747744 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:08.747696 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fmmvs" podStartSLOduration=0.747681936 podStartE2EDuration="747.681936ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:08.746578125 +0000 UTC m=+273.699380519" watchObservedRunningTime="2026-06-11 18:41:08.747681936 +0000 UTC m=+273.700484329" Jun 11 18:41:21.169484 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:21.169447 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:21.254667 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:21.254611 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:21.773188 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:21.773152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:21.955734 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:21.955696 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.058134 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.058024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.097869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.097837 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf"] Jun 11 18:41:22.100142 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.100119 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.102727 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.102704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 18:41:22.102867 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.102847 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 18:41:22.103102 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.103084 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d7tvg\"" Jun 11 18:41:22.103157 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.103104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 18:41:22.103204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.103152 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 18:41:22.116978 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.116949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf"] Jun 11 18:41:22.213421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.213389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.253686 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.253634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.253834 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.253694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.253834 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.253749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.253834 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.253775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s826c\" (UniqueName: \"kubernetes.io/projected/806fcf64-f422-4a21-b45e-f11089184e69-kube-api-access-s826c\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.253834 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.253821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.314371 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.314293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.354634 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.354607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.354634 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.354637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s826c\" (UniqueName: \"kubernetes.io/projected/806fcf64-f422-4a21-b45e-f11089184e69-kube-api-access-s826c\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.354830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.354698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.354830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.354724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.354830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.354753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.355114 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.355090 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.356849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.356819 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/806fcf64-f422-4a21-b45e-f11089184e69-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.357100 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.357078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.357208 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.357188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/806fcf64-f422-4a21-b45e-f11089184e69-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.366138 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.366116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s826c\" (UniqueName: \"kubernetes.io/projected/806fcf64-f422-4a21-b45e-f11089184e69-kube-api-access-s826c\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-2vwhf\" (UID: \"806fcf64-f422-4a21-b45e-f11089184e69\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.410756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.410732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:22.423117 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.423089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.516206 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.516177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.538794 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.538764 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf"] Jun 11 18:41:22.541827 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:41:22.541793 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806fcf64_f422_4a21_b45e_f11089184e69.slice/crio-4616ce51cb229f6701a9cf2a016e6ae1b08bb63de080c59440844003e44fbba0 WatchSource:0}: Error finding container 4616ce51cb229f6701a9cf2a016e6ae1b08bb63de080c59440844003e44fbba0: Status 404 returned error can't find the container with id 4616ce51cb229f6701a9cf2a016e6ae1b08bb63de080c59440844003e44fbba0 Jun 11 18:41:22.616432 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.616359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:22.788857 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:22.788823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" event={"ID":"806fcf64-f422-4a21-b45e-f11089184e69","Type":"ContainerStarted","Data":"4616ce51cb229f6701a9cf2a016e6ae1b08bb63de080c59440844003e44fbba0"} Jun 11 18:41:25.801692 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:25.801638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" event={"ID":"806fcf64-f422-4a21-b45e-f11089184e69","Type":"ContainerStarted","Data":"3aba7c881235b0add82b45bc8901fad312b25112a0f6011c92301d2bae353ea8"} Jun 11 18:41:26.807344 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:26.807312 2567 generic.go:356] "Generic (PLEG): container finished" podID="806fcf64-f422-4a21-b45e-f11089184e69" containerID="3aba7c881235b0add82b45bc8901fad312b25112a0f6011c92301d2bae353ea8" exitCode=0 Jun 11 18:41:26.807733 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:26.807384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" event={"ID":"806fcf64-f422-4a21-b45e-f11089184e69","Type":"ContainerDied","Data":"3aba7c881235b0add82b45bc8901fad312b25112a0f6011c92301d2bae353ea8"} Jun 11 18:41:27.812669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:27.812619 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" event={"ID":"806fcf64-f422-4a21-b45e-f11089184e69","Type":"ContainerStarted","Data":"1ae02c81f0d562a0274b7b674407d8882233e1ce0b18dd16e23c04c72c79119a"} Jun 11 18:41:27.813030 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:27.812720 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:27.840622 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:27.840568 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" podStartSLOduration=1.72071939 podStartE2EDuration="5.840555548s" totalImagesPullingTime="3.207833521s" totalInitContainerRuntime="912.002637ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:27.839830285 +0000 UTC m=+292.792632698" watchObservedRunningTime="2026-06-11 18:41:27.840555548 +0000 UTC m=+292.793357941" Jun 11 18:41:33.395326 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:33.395297 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:33.496174 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:33.496140 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:35.396073 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:35.396030 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:41:35.397031 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:35.397006 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:41:35.402617 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:35.402595 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 18:41:38.817796 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:38.817764 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-2vwhf" Jun 11 18:41:39.698083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.697999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:39.779467 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.779429 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:39.798878 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.798848 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-cct97"] Jun 11 18:41:39.801176 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.801160 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.805008 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.804987 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 18:41:39.805150 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.805045 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 18:41:39.805150 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.804991 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:41:39.805150 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.804991 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9rpv8\"" Jun 11 18:41:39.805150 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.805046 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 18:41:39.805384 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.804991 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 18:41:39.815438 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.815416 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-cct97"] Jun 11 18:41:39.897677 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.897629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.898085 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.897683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrqn\" (UniqueName: \"kubernetes.io/projected/4e1c6914-45eb-44da-9393-5cf0ced88b0c-kube-api-access-jqrqn\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.898085 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.897787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-metrics-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.898085 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.897846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e1c6914-45eb-44da-9393-5cf0ced88b0c-manager-config\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.998497 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.998418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrqn\" (UniqueName: \"kubernetes.io/projected/4e1c6914-45eb-44da-9393-5cf0ced88b0c-kube-api-access-jqrqn\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.998672 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.998495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-metrics-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.998672 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.998537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e1c6914-45eb-44da-9393-5cf0ced88b0c-manager-config\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.998672 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.998585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:39.999253 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:39.999229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e1c6914-45eb-44da-9393-5cf0ced88b0c-manager-config\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:40.001128 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.001098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:40.001291 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.001098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e1c6914-45eb-44da-9393-5cf0ced88b0c-metrics-cert\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:40.014967 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.014947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrqn\" (UniqueName: \"kubernetes.io/projected/4e1c6914-45eb-44da-9393-5cf0ced88b0c-kube-api-access-jqrqn\") pod \"lws-controller-manager-657f978cc6-cct97\" (UID: \"4e1c6914-45eb-44da-9393-5cf0ced88b0c\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:40.110227 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.110202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:40.247962 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.247936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-cct97"] Jun 11 18:41:40.250450 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:41:40.250391 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1c6914_45eb_44da_9393_5cf0ced88b0c.slice/crio-c76094b56c47a3b6f16c04859474ba0b5c7095ddab863c53706257b44bf51d12 WatchSource:0}: Error finding container c76094b56c47a3b6f16c04859474ba0b5c7095ddab863c53706257b44bf51d12: Status 404 returned error can't find the container with id c76094b56c47a3b6f16c04859474ba0b5c7095ddab863c53706257b44bf51d12 Jun 11 18:41:40.252286 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.252270 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:41:40.451775 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.451741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:40.598853 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.598821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:40.850999 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.850916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:40.860628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.860598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" event={"ID":"4e1c6914-45eb-44da-9393-5cf0ced88b0c","Type":"ContainerStarted","Data":"c76094b56c47a3b6f16c04859474ba0b5c7095ddab863c53706257b44bf51d12"} Jun 11 18:41:40.993545 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:40.993515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:41.098815 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.098784 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:41.437555 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.437516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:41.508368 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.508333 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dl259"] Jun 11 18:41:41.511457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.511436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.517706 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.517585 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 18:41:41.518838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.518792 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gjs47\"" Jun 11 18:41:41.562203 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.562139 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dl259"] Jun 11 18:41:41.613157 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.613102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t52xh\" (UniqueName: \"kubernetes.io/projected/b8437c75-e332-45b1-964f-8852114b9850-kube-api-access-t52xh\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.613355 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.613202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.661114 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.661017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:41.715202 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.714730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.715202 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.714837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t52xh\" (UniqueName: \"kubernetes.io/projected/b8437c75-e332-45b1-964f-8852114b9850-kube-api-access-t52xh\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.715202 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:41:41.714926 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 18:41:41.715202 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:41:41.715004 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert podName:b8437c75-e332-45b1-964f-8852114b9850 nodeName:}" failed. No retries permitted until 2026-06-11 18:41:42.214981079 +0000 UTC m=+307.167783454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert") pod "odh-model-controller-6dc94f689f-dl259" (UID: "b8437c75-e332-45b1-964f-8852114b9850") : secret "odh-model-controller-webhook-cert" not found Jun 11 18:41:41.728221 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.728165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t52xh\" (UniqueName: \"kubernetes.io/projected/b8437c75-e332-45b1-964f-8852114b9850-kube-api-access-t52xh\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:41.795228 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.795190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:41.883875 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:41.883829 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:42.220094 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:42.220055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:42.222578 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:42.222545 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8437c75-e332-45b1-964f-8852114b9850-cert\") pod \"odh-model-controller-6dc94f689f-dl259\" (UID: \"b8437c75-e332-45b1-964f-8852114b9850\") " pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:42.312343 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:42.312307 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:42.438869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:42.438834 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:42.768346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:42.768311 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:43.273917 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:43.273883 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dl259"] Jun 11 18:41:43.276841 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:41:43.276816 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8437c75_e332_45b1_964f_8852114b9850.slice/crio-a866e1f4558bfb2284a25bfadc4140314f69931b3ccf423fe1780eaf43f17aed WatchSource:0}: Error finding container a866e1f4558bfb2284a25bfadc4140314f69931b3ccf423fe1780eaf43f17aed: Status 404 returned error can't find the container with id a866e1f4558bfb2284a25bfadc4140314f69931b3ccf423fe1780eaf43f17aed Jun 11 18:41:43.875965 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:43.875925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" event={"ID":"4e1c6914-45eb-44da-9393-5cf0ced88b0c","Type":"ContainerStarted","Data":"130295da67100a0c47d4e361bf3c0dd7512bfcd1732d807f2fb48779873e0641"} Jun 11 18:41:43.876168 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:43.876028 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:43.877232 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:43.877207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" event={"ID":"b8437c75-e332-45b1-964f-8852114b9850","Type":"ContainerStarted","Data":"a866e1f4558bfb2284a25bfadc4140314f69931b3ccf423fe1780eaf43f17aed"} Jun 11 18:41:43.894204 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:43.894143 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" podStartSLOduration=1.9702771019999998 podStartE2EDuration="4.894121384s" totalImagesPullingTime="2.923844282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:43.891993193 +0000 UTC m=+308.844795590" watchObservedRunningTime="2026-06-11 18:41:43.894121384 +0000 UTC m=+308.846923779" Jun 11 18:41:46.889808 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:46.889774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" event={"ID":"b8437c75-e332-45b1-964f-8852114b9850","Type":"ContainerStarted","Data":"4bcc6238aa02625c7d65a1c6a84f544bc3e25a520dcc8e897b9c6b8b74ec21f7"} Jun 11 18:41:46.890214 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:46.890007 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:46.910492 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:46.910341 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" podStartSLOduration=3.118194291 podStartE2EDuration="5.910323484s" totalImagesPullingTime="2.792129193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:46.909665772 +0000 UTC m=+311.862468187" watchObservedRunningTime="2026-06-11 18:41:46.910323484 +0000 UTC m=+311.863125880" Jun 11 18:41:51.780039 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.779992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:51.848628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.848591 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm"] Jun 11 18:41:51.851602 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.851582 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:51.854239 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.854216 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xrvnh\"" Jun 11 18:41:51.854500 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.854486 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 18:41:51.864065 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.864041 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm"] Jun 11 18:41:51.871156 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.871137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:51.903455 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.903423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqm7d\" (UniqueName: \"kubernetes.io/projected/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-kube-api-access-kqm7d\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:51.903637 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.903508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:51.988513 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:51.988478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:52.004273 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.004247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:52.004418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.004287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqm7d\" (UniqueName: \"kubernetes.io/projected/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-kube-api-access-kqm7d\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:52.006606 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.006578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:52.016428 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.016406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqm7d\" (UniqueName: \"kubernetes.io/projected/d3fa99e0-fc70-493d-bf6c-b65a4b0a967e-kube-api-access-kqm7d\") pod \"llmisvc-controller-manager-864bfd7bc9-xsmrm\" (UID: \"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:52.162517 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.162436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:52.202485 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.202456 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:52.290215 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.290184 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm"] Jun 11 18:41:52.292539 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:41:52.292505 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3fa99e0_fc70_493d_bf6c_b65a4b0a967e.slice/crio-f905287be8cbc02893f8646fd543a636011e9e9cb4a5933d13c8969e454fef15 WatchSource:0}: Error finding container f905287be8cbc02893f8646fd543a636011e9e9cb4a5933d13c8969e454fef15: Status 404 returned error can't find the container with id f905287be8cbc02893f8646fd543a636011e9e9cb4a5933d13c8969e454fef15 Jun 11 18:41:52.918952 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:52.918913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" event={"ID":"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e","Type":"ContainerStarted","Data":"f905287be8cbc02893f8646fd543a636011e9e9cb4a5933d13c8969e454fef15"} Jun 11 18:41:53.197487 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:53.197410 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:53.267487 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:53.267453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:54.883279 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:54.883222 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-cct97" Jun 11 18:41:55.935641 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:55.935601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" event={"ID":"d3fa99e0-fc70-493d-bf6c-b65a4b0a967e","Type":"ContainerStarted","Data":"89fe647b1cad4f70bd1a666176a2b7220fef2c4c8f280c46287383f9ef471faa"} Jun 11 18:41:55.936063 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:55.935716 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:41:55.954181 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:55.954142 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" podStartSLOduration=1.790971206 podStartE2EDuration="4.954128417s" totalImagesPullingTime="3.163157211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:55.953638305 +0000 UTC m=+320.906440699" watchObservedRunningTime="2026-06-11 18:41:55.954128417 +0000 UTC m=+320.906930810" Jun 11 18:41:57.484433 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:57.484401 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:57.582344 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:57.582311 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:57.896176 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:57.896149 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-dl259" Jun 11 18:41:58.823851 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:58.823820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:58.924601 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:58.924570 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:59.341114 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:59.341070 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:59.638773 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:59.638691 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:59.902985 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:41:59.902906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:00.197987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.197912 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv"] Jun 11 18:42:00.216349 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.216325 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.219621 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.219423 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 18:42:00.219621 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.219487 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 18:42:00.219873 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.219858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-47rtq\"" Jun 11 18:42:00.221543 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.221515 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv"] Jun 11 18:42:00.279152 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.279117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgvwv\" (UniqueName: \"kubernetes.io/projected/af857d38-44ac-42b8-b156-c27dc4e79102-kube-api-access-cgvwv\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.279323 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.279220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/af857d38-44ac-42b8-b156-c27dc4e79102-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.379792 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.379754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/af857d38-44ac-42b8-b156-c27dc4e79102-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.379989 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.379816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgvwv\" (UniqueName: \"kubernetes.io/projected/af857d38-44ac-42b8-b156-c27dc4e79102-kube-api-access-cgvwv\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.382350 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.382326 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/af857d38-44ac-42b8-b156-c27dc4e79102-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.406103 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.406077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgvwv\" (UniqueName: \"kubernetes.io/projected/af857d38-44ac-42b8-b156-c27dc4e79102-kube-api-access-cgvwv\") pod \"servicemesh-operator3-57f65f65fb-kdxfv\" (UID: \"af857d38-44ac-42b8-b156-c27dc4e79102\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.527353 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.527323 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:00.669690 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.669666 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv"] Jun 11 18:42:00.672246 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:00.672214 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf857d38_44ac_42b8_b156_c27dc4e79102.slice/crio-07f5d28ca1a2d75fa96c3a68f12771f9274a0fdf709e98ca4f63b273fd09452f WatchSource:0}: Error finding container 07f5d28ca1a2d75fa96c3a68f12771f9274a0fdf709e98ca4f63b273fd09452f: Status 404 returned error can't find the container with id 07f5d28ca1a2d75fa96c3a68f12771f9274a0fdf709e98ca4f63b273fd09452f Jun 11 18:42:00.964941 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:00.964856 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" event={"ID":"af857d38-44ac-42b8-b156-c27dc4e79102","Type":"ContainerStarted","Data":"07f5d28ca1a2d75fa96c3a68f12771f9274a0fdf709e98ca4f63b273fd09452f"} Jun 11 18:42:03.980717 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:03.980677 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" event={"ID":"af857d38-44ac-42b8-b156-c27dc4e79102","Type":"ContainerStarted","Data":"ec7b698d8ecb620dcba0a7e8fdcc07298142cfd4d0107faede38bf87e6f38988"} Jun 11 18:42:03.981104 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:03.980755 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:04.002535 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:04.002470 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" podStartSLOduration=1.277069972 podStartE2EDuration="4.002452751s" totalImagesPullingTime="2.725382779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:04.000363967 +0000 UTC m=+328.953166387" watchObservedRunningTime="2026-06-11 18:42:04.002452751 +0000 UTC m=+328.955255146" Jun 11 18:42:04.734400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:04.734352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:04.800148 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:04.800116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:09.722336 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:09.722297 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:09.819181 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:09.819148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:10.871799 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:10.871761 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:10.951093 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:10.951060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:11.415171 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:11.415140 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:14.970430 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:14.970394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:14.987940 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:14.987916 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kdxfv" Jun 11 18:42:15.070925 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.070896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:15.247746 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.247675 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:15.250050 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.250032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.253087 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.253067 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 18:42:15.253849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.253829 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 18:42:15.253965 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.253892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b5qj7\"" Jun 11 18:42:15.254182 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.254166 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 18:42:15.266503 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.266475 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:15.288497 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.288473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:15.415628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415628 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wrx\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.415849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.416034 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.416034 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.415891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.472982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.472948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:15.499049 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.498975 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt"] Jun 11 18:42:15.501878 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.501862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.516319 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516464 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516464 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516636 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wrx\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516636 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516636 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516636 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516874 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516874 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.516874 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.516729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.517172 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.517145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.517295 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.517227 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.517295 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.517230 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.517420 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.517394 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.518865 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.518847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.519329 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.519305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.522744 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.522718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt"] Jun 11 18:42:15.530274 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.530242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wrx\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.534773 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.534755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.560784 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.560763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:15.617744 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.617698 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.617876 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.617798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.617876 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.617828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4848c8-217d-46f0-ba95-59803361636c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.617983 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.617909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqcvn\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-kube-api-access-hqcvn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.617983 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.617977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.618065 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.618006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4848c8-217d-46f0-ba95-59803361636c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.618105 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.618072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.618148 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.618116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.618210 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.618191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.704400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.704375 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:15.706962 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:15.706935 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6706e7_70e2_44eb_9b13_1af5255d46eb.slice/crio-7b47ca241bc7bc2d93b854b4ef7974b991b72c2b2d85a10d5cde1a61d316f515 WatchSource:0}: Error finding container 7b47ca241bc7bc2d93b854b4ef7974b991b72c2b2d85a10d5cde1a61d316f515: Status 404 returned error can't find the container with id 7b47ca241bc7bc2d93b854b4ef7974b991b72c2b2d85a10d5cde1a61d316f515 Jun 11 18:42:15.718631 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718739 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718739 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718863 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4848c8-217d-46f0-ba95-59803361636c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718922 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqcvn\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-kube-api-access-hqcvn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.718982 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4848c8-217d-46f0-ba95-59803361636c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719088 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.718976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719088 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719088 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719274 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719340 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719577 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.719941 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.719913 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4848c8-217d-46f0-ba95-59803361636c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.721304 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.721283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4848c8-217d-46f0-ba95-59803361636c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.721757 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.721736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4848c8-217d-46f0-ba95-59803361636c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.728212 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.728191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:15.736926 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.736904 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.746976 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.746956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqcvn\" (UniqueName: \"kubernetes.io/projected/7f4848c8-217d-46f0-ba95-59803361636c-kube-api-access-hqcvn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795fflbt\" (UID: \"7f4848c8-217d-46f0-ba95-59803361636c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.812905 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.812875 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:15.974345 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:15.974311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt"] Jun 11 18:42:15.979414 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:15.979388 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4848c8_217d_46f0_ba95_59803361636c.slice/crio-a8f2b6f6022e0b6dc274a4a4ba11163a1e5f4850525992c2c8267b8d945cdce2 WatchSource:0}: Error finding container a8f2b6f6022e0b6dc274a4a4ba11163a1e5f4850525992c2c8267b8d945cdce2: Status 404 returned error can't find the container with id a8f2b6f6022e0b6dc274a4a4ba11163a1e5f4850525992c2c8267b8d945cdce2 Jun 11 18:42:16.037601 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:16.037564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" event={"ID":"7f4848c8-217d-46f0-ba95-59803361636c","Type":"ContainerStarted","Data":"a8f2b6f6022e0b6dc274a4a4ba11163a1e5f4850525992c2c8267b8d945cdce2"} Jun 11 18:42:16.038785 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:16.038761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" event={"ID":"4a6706e7-70e2-44eb-9b13-1af5255d46eb","Type":"ContainerStarted","Data":"7b47ca241bc7bc2d93b854b4ef7974b991b72c2b2d85a10d5cde1a61d316f515"} Jun 11 18:42:18.801186 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.801134 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:18.801516 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.801219 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:18.801516 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.801248 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:18.806979 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.806935 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:18.807083 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.807041 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:18.807131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:18.807091 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:42:19.057219 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.057122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" event={"ID":"4a6706e7-70e2-44eb-9b13-1af5255d46eb","Type":"ContainerStarted","Data":"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758"} Jun 11 18:42:19.058799 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.058755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" event={"ID":"7f4848c8-217d-46f0-ba95-59803361636c","Type":"ContainerStarted","Data":"5d22d439482d9a8e9003da76174c31ef1c70886e9b3877be365836e88bd7e946"} Jun 11 18:42:19.080312 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.080259 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" podStartSLOduration=0.982639477 podStartE2EDuration="4.080243556s" totalImagesPullingTime="3.097604079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:19.078687892 +0000 UTC m=+344.031490288" watchObservedRunningTime="2026-06-11 18:42:19.080243556 +0000 UTC m=+344.033046015" Jun 11 18:42:19.099849 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.099787 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" podStartSLOduration=1.28055334 podStartE2EDuration="4.099767377s" totalImagesPullingTime="2.819214037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:19.098774147 +0000 UTC m=+344.051576553" watchObservedRunningTime="2026-06-11 18:42:19.099767377 +0000 UTC m=+344.052569773" Jun 11 18:42:19.357241 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.357147 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-tkbf7"] Jun 11 18:42:19.359615 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.359593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.363021 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.362999 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8n27r\"" Jun 11 18:42:19.363316 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.363298 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 18:42:19.369535 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.369511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-tkbf7"] Jun 11 18:42:19.390331 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.390302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:19.455360 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.455321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nb5\" (UniqueName: \"kubernetes.io/projected/9be9ecf1-0a18-4d04-a293-3db8674fa53e-kube-api-access-c7nb5\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.455538 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.455429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be9ecf1-0a18-4d04-a293-3db8674fa53e-redirect-config\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.556388 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.556355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nb5\" (UniqueName: \"kubernetes.io/projected/9be9ecf1-0a18-4d04-a293-3db8674fa53e-kube-api-access-c7nb5\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.556568 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.556511 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be9ecf1-0a18-4d04-a293-3db8674fa53e-redirect-config\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.557253 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.557230 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be9ecf1-0a18-4d04-a293-3db8674fa53e-redirect-config\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.561838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.561823 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:19.563368 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.563343 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 11 18:42:19.563462 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.563397 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 11 18:42:19.564677 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.564641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nb5\" (UniqueName: \"kubernetes.io/projected/9be9ecf1-0a18-4d04-a293-3db8674fa53e-kube-api-access-c7nb5\") pod \"dashboard-redirect-78fd5d586f-tkbf7\" (UID: \"9be9ecf1-0a18-4d04-a293-3db8674fa53e\") " pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.671859 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.671768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" Jun 11 18:42:19.796857 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.796759 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-tkbf7"] Jun 11 18:42:19.799232 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:19.799203 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be9ecf1_0a18_4d04_a293_3db8674fa53e.slice/crio-c2ae9b36d61a58ce4e91840692faf3e36f6bea6cec70d61af46e2f03edbe7389 WatchSource:0}: Error finding container c2ae9b36d61a58ce4e91840692faf3e36f6bea6cec70d61af46e2f03edbe7389: Status 404 returned error can't find the container with id c2ae9b36d61a58ce4e91840692faf3e36f6bea6cec70d61af46e2f03edbe7389 Jun 11 18:42:19.813526 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.813506 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:19.818250 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:19.818231 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:20.063961 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.063923 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" event={"ID":"9be9ecf1-0a18-4d04-a293-3db8674fa53e","Type":"ContainerStarted","Data":"c2ae9b36d61a58ce4e91840692faf3e36f6bea6cec70d61af46e2f03edbe7389"} Jun 11 18:42:20.064298 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.064280 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:20.065341 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.065320 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795fflbt" Jun 11 18:42:20.118658 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.118625 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:20.561580 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.561547 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 11 18:42:20.561737 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:20.561597 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 11 18:42:21.561467 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:21.561419 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 11 18:42:21.561931 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:21.561501 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 11 18:42:22.077419 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:22.077373 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" event={"ID":"9be9ecf1-0a18-4d04-a293-3db8674fa53e","Type":"ContainerStarted","Data":"c9a17dc3b365c9c0af6f75e88b83d541b4e9962239f21f303a903c6002ad4ebd"} Jun 11 18:42:22.077864 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:22.077820 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" containerID="cri-o://b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758" gracePeriod=30 Jun 11 18:42:22.092470 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:22.092382 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78fd5d586f-tkbf7" podStartSLOduration=0.96813799 podStartE2EDuration="3.09236613s" totalImagesPullingTime="2.12422814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:22.09160241 +0000 UTC m=+347.044404805" watchObservedRunningTime="2026-06-11 18:42:22.09236613 +0000 UTC m=+347.045168548" Jun 11 18:42:26.942839 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:26.942766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xsmrm" Jun 11 18:42:27.314850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.314824 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:27.425715 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.425678 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6wrx\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.425862 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.425726 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.425862 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.425766 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.425984 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.425963 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426025 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.425995 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:27.426025 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426007 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426087 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426040 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426132 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426090 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426132 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426120 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426155 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert\") pod \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\" (UID: \"4a6706e7-70e2-44eb-9b13-1af5255d46eb\") " Jun 11 18:42:27.426238 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426202 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:27.426342 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426268 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:27.426342 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426326 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:27.426548 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426526 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-data\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.426678 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426558 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-socket\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.426678 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426575 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-credential-socket\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.426678 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426590 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-workload-certs\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.426678 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.426529 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:42:27.428286 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.428249 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 18:42:27.428402 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.428286 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:27.428497 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.428478 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx" (OuterVolumeSpecName: "kube-api-access-p6wrx") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "kube-api-access-p6wrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:27.428573 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.428556 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a6706e7-70e2-44eb-9b13-1af5255d46eb" (UID: "4a6706e7-70e2-44eb-9b13-1af5255d46eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:27.527400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.527365 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6wrx\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-kube-api-access-p6wrx\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.527400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.527396 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-token\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.527400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.527405 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-envoy\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.527624 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.527413 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istio-podinfo\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:27.527624 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:27.527421 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a6706e7-70e2-44eb-9b13-1af5255d46eb-istiod-ca-cert\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:28.104464 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.104422 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerID="b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758" exitCode=0 Jun 11 18:42:28.104961 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.104488 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" Jun 11 18:42:28.104961 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.104513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" event={"ID":"4a6706e7-70e2-44eb-9b13-1af5255d46eb","Type":"ContainerDied","Data":"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758"} Jun 11 18:42:28.104961 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.104597 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb" event={"ID":"4a6706e7-70e2-44eb-9b13-1af5255d46eb","Type":"ContainerDied","Data":"7b47ca241bc7bc2d93b854b4ef7974b991b72c2b2d85a10d5cde1a61d316f515"} Jun 11 18:42:28.104961 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.104622 2567 scope.go:117] "RemoveContainer" containerID="b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758" Jun 11 18:42:28.113126 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.113066 2567 scope.go:117] "RemoveContainer" containerID="b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758" Jun 11 18:42:28.113358 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:42:28.113332 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758\": container with ID starting with b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758 not found: ID does not exist" containerID="b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758" Jun 11 18:42:28.113414 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.113371 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758"} err="failed to get container status \"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758\": rpc error: code = NotFound desc = could not find container \"b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758\": container with ID starting with b9321a18b2e4869f01e995e38a5ae4f5f84f571806fc900cc92506181a806758 not found: ID does not exist" Jun 11 18:42:28.124277 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.124253 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:28.128604 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:28.128583 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6f55pqb"] Jun 11 18:42:29.457764 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:29.457727 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" path="/var/lib/kubelet/pods/4a6706e7-70e2-44eb-9b13-1af5255d46eb/volumes" Jun 11 18:42:42.173089 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.173055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:42.274798 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.274767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:42.297162 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.297132 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:42.297454 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.297442 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" Jun 11 18:42:42.297500 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.297456 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" Jun 11 18:42:42.297534 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.297509 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6706e7-70e2-44eb-9b13-1af5255d46eb" containerName="istio-proxy" Jun 11 18:42:42.306472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.306448 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:42.309149 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.309114 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:42:42.309377 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.309355 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:42:42.309488 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.309460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:42.310076 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.310054 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dgkgl\"" Jun 11 18:42:42.349501 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.349460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:42.354698 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.354671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nntn\" (UniqueName: \"kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn\") pod \"kuadrant-operator-catalog-c7mjp\" (UID: \"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305\") " pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:42.455251 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.455179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nntn\" (UniqueName: \"kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn\") pod \"kuadrant-operator-catalog-c7mjp\" (UID: \"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305\") " pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:42.463184 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.463162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nntn\" (UniqueName: \"kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn\") pod \"kuadrant-operator-catalog-c7mjp\" (UID: \"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305\") " pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:42.618139 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.618104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:42.661334 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.661303 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:42.744991 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.744953 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:42.747572 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:42.747549 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f63ba4_7f8a_4ba4_8c3f_9d896ac7a305.slice/crio-46d5a212ed6be880e47e0110022df1b16196f927312ec0755b11cd776195600e WatchSource:0}: Error finding container 46d5a212ed6be880e47e0110022df1b16196f927312ec0755b11cd776195600e: Status 404 returned error can't find the container with id 46d5a212ed6be880e47e0110022df1b16196f927312ec0755b11cd776195600e Jun 11 18:42:42.872182 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.872156 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwj6"] Jun 11 18:42:42.874997 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.874982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:42.884239 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.884213 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwj6"] Jun 11 18:42:42.959918 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:42.959889 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zj8d\" (UniqueName: \"kubernetes.io/projected/870ab8bb-d4f7-4de1-a367-1b4f1ed2d133-kube-api-access-8zj8d\") pod \"kuadrant-operator-catalog-zrwj6\" (UID: \"870ab8bb-d4f7-4de1-a367-1b4f1ed2d133\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:43.061279 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.061239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zj8d\" (UniqueName: \"kubernetes.io/projected/870ab8bb-d4f7-4de1-a367-1b4f1ed2d133-kube-api-access-8zj8d\") pod \"kuadrant-operator-catalog-zrwj6\" (UID: \"870ab8bb-d4f7-4de1-a367-1b4f1ed2d133\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:43.072296 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.072265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zj8d\" (UniqueName: \"kubernetes.io/projected/870ab8bb-d4f7-4de1-a367-1b4f1ed2d133-kube-api-access-8zj8d\") pod \"kuadrant-operator-catalog-zrwj6\" (UID: \"870ab8bb-d4f7-4de1-a367-1b4f1ed2d133\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:43.096674 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.096634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:43.171732 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.171695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" event={"ID":"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305","Type":"ContainerStarted","Data":"46d5a212ed6be880e47e0110022df1b16196f927312ec0755b11cd776195600e"} Jun 11 18:42:43.184902 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.184874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:43.306756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.306721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:43.314759 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:43.314734 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwj6"] Jun 11 18:42:43.358127 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:42:43.358093 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870ab8bb_d4f7_4de1_a367_1b4f1ed2d133.slice/crio-fd45424e89f317f5652aca20e2b46a3ee128ee51fb750f095cea8d77c7a688c7 WatchSource:0}: Error finding container fd45424e89f317f5652aca20e2b46a3ee128ee51fb750f095cea8d77c7a688c7: Status 404 returned error can't find the container with id fd45424e89f317f5652aca20e2b46a3ee128ee51fb750f095cea8d77c7a688c7 Jun 11 18:42:44.177525 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:44.177485 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" event={"ID":"870ab8bb-d4f7-4de1-a367-1b4f1ed2d133","Type":"ContainerStarted","Data":"fd45424e89f317f5652aca20e2b46a3ee128ee51fb750f095cea8d77c7a688c7"} Jun 11 18:42:45.183302 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.183199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" event={"ID":"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305","Type":"ContainerStarted","Data":"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32"} Jun 11 18:42:45.183302 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.183215 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" podUID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" containerName="registry-server" containerID="cri-o://0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32" gracePeriod=2 Jun 11 18:42:45.184603 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.184582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" event={"ID":"870ab8bb-d4f7-4de1-a367-1b4f1ed2d133","Type":"ContainerStarted","Data":"24030c3a8cbefd2ee93e37ccb258671095467d4b402915bd1098b5e5e4616fe4"} Jun 11 18:42:45.202400 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.202359 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" podStartSLOduration=1.178251151 podStartE2EDuration="3.202344554s" totalImagesPullingTime="2.024093403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:45.201549705 +0000 UTC m=+370.154352104" watchObservedRunningTime="2026-06-11 18:42:45.202344554 +0000 UTC m=+370.155146948" Jun 11 18:42:45.220473 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.220433 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" podStartSLOduration=1.803625248 podStartE2EDuration="3.220419065s" totalImagesPullingTime="1.416793817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:45.217494297 +0000 UTC m=+370.170296691" watchObservedRunningTime="2026-06-11 18:42:45.220419065 +0000 UTC m=+370.173221459" Jun 11 18:42:45.428267 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.428242 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:45.484724 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.484627 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nntn\" (UniqueName: \"kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn\") pod \"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305\" (UID: \"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305\") " Jun 11 18:42:45.486703 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.486678 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn" (OuterVolumeSpecName: "kube-api-access-5nntn") pod "f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" (UID: "f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305"). InnerVolumeSpecName "kube-api-access-5nntn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:45.585708 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:45.585678 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nntn\" (UniqueName: \"kubernetes.io/projected/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305-kube-api-access-5nntn\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:42:46.190838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.190750 2567 generic.go:356] "Generic (PLEG): container finished" podID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" containerID="0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32" exitCode=0 Jun 11 18:42:46.190838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.190803 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" Jun 11 18:42:46.191256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.190834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" event={"ID":"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305","Type":"ContainerDied","Data":"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32"} Jun 11 18:42:46.191256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.190881 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7mjp" event={"ID":"f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305","Type":"ContainerDied","Data":"46d5a212ed6be880e47e0110022df1b16196f927312ec0755b11cd776195600e"} Jun 11 18:42:46.191256 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.190900 2567 scope.go:117] "RemoveContainer" containerID="0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32" Jun 11 18:42:46.200211 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.200195 2567 scope.go:117] "RemoveContainer" containerID="0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32" Jun 11 18:42:46.200455 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:42:46.200435 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32\": container with ID starting with 0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32 not found: ID does not exist" containerID="0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32" Jun 11 18:42:46.200560 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.200467 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32"} err="failed to get container status \"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32\": rpc error: code = NotFound desc = could not find container \"0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32\": container with ID starting with 0d081b9ee6686424d6510d916bd96d3a3d4a0e48b30806ad9d78ce5b68a49d32 not found: ID does not exist" Jun 11 18:42:46.211929 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.211907 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:46.216070 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:46.216050 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7mjp"] Jun 11 18:42:47.458081 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:47.458043 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" path="/var/lib/kubelet/pods/f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305/volumes" Jun 11 18:42:53.185862 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:53.185821 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:53.186391 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:53.186116 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:53.207825 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:53.207803 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:42:53.244292 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:42:53.244264 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zrwj6" Jun 11 18:43:01.147359 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:01.147327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:06.218388 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:06.218355 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:08.003251 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:08.003213 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:10.632817 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.632781 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h"] Jun 11 18:43:10.633179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.633090 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" containerName="registry-server" Jun 11 18:43:10.633179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.633101 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" containerName="registry-server" Jun 11 18:43:10.633179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.633175 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9f63ba4-7f8a-4ba4-8c3f-9d896ac7a305" containerName="registry-server" Jun 11 18:43:10.636089 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.636071 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:10.638820 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.638792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 18:43:10.639435 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.639420 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zvpjl\"" Jun 11 18:43:10.649733 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.649710 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h"] Jun 11 18:43:10.692515 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.692478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5k6b\" (UniqueName: \"kubernetes.io/projected/75c2fb45-c275-430c-a69e-9df0ec7d81e8-kube-api-access-t5k6b\") pod \"dns-operator-controller-manager-864dd78c4c-ksb9h\" (UID: \"75c2fb45-c275-430c-a69e-9df0ec7d81e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:10.793840 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.793808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5k6b\" (UniqueName: \"kubernetes.io/projected/75c2fb45-c275-430c-a69e-9df0ec7d81e8-kube-api-access-t5k6b\") pod \"dns-operator-controller-manager-864dd78c4c-ksb9h\" (UID: \"75c2fb45-c275-430c-a69e-9df0ec7d81e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:10.806439 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.806411 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5k6b\" (UniqueName: \"kubernetes.io/projected/75c2fb45-c275-430c-a69e-9df0ec7d81e8-kube-api-access-t5k6b\") pod \"dns-operator-controller-manager-864dd78c4c-ksb9h\" (UID: \"75c2fb45-c275-430c-a69e-9df0ec7d81e8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:10.946679 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:10.946587 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:11.075138 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:11.075114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h"] Jun 11 18:43:11.077603 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:43:11.077576 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c2fb45_c275_430c_a69e_9df0ec7d81e8.slice/crio-5a1d78be1e2193cb4a87418a08a1e57cd15d0b4caaca70cedf3aaa44407b85b5 WatchSource:0}: Error finding container 5a1d78be1e2193cb4a87418a08a1e57cd15d0b4caaca70cedf3aaa44407b85b5: Status 404 returned error can't find the container with id 5a1d78be1e2193cb4a87418a08a1e57cd15d0b4caaca70cedf3aaa44407b85b5 Jun 11 18:43:11.300659 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:11.300616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" event={"ID":"75c2fb45-c275-430c-a69e-9df0ec7d81e8","Type":"ContainerStarted","Data":"5a1d78be1e2193cb4a87418a08a1e57cd15d0b4caaca70cedf3aaa44407b85b5"} Jun 11 18:43:12.184349 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:12.184316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:12.473121 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:12.473034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:12.550978 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:12.550949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:12.655944 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:12.655915 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:12.759372 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:12.759300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:13.311697 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:13.311666 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" event={"ID":"75c2fb45-c275-430c-a69e-9df0ec7d81e8","Type":"ContainerStarted","Data":"e36db591dbf7b291aede184568f1f059d59fa50f3ada4dce8e9cfaa195c2d9b2"} Jun 11 18:43:13.312131 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:13.311763 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:13.329662 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:13.329604 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" podStartSLOduration=1.296001023 podStartE2EDuration="3.329589469s" totalImagesPullingTime="2.033588446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:13.327785872 +0000 UTC m=+398.280588267" watchObservedRunningTime="2026-06-11 18:43:13.329589469 +0000 UTC m=+398.282391918" Jun 11 18:43:14.107575 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.107540 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd"] Jun 11 18:43:14.110826 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.110809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:14.114164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.114140 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jwzl9\"" Jun 11 18:43:14.115778 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.115759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtkq\" (UniqueName: \"kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq\") pod \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" (UID: \"b23be42a-33c0-40a4-9668-9f8f4165a29f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:14.121770 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.121743 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd"] Jun 11 18:43:14.217041 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.217007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtkq\" (UniqueName: \"kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq\") pod \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" (UID: \"b23be42a-33c0-40a4-9668-9f8f4165a29f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:14.226691 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.226661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtkq\" (UniqueName: \"kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq\") pod \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" (UID: \"b23be42a-33c0-40a4-9668-9f8f4165a29f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:14.422165 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.422079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:14.571704 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.571673 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd"] Jun 11 18:43:14.574861 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:43:14.574826 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23be42a_33c0_40a4_9668_9f8f4165a29f.slice/crio-73f17c8b752204ae6eb338904ca999d6061542315ced5f1184f43eacbb067d41 WatchSource:0}: Error finding container 73f17c8b752204ae6eb338904ca999d6061542315ced5f1184f43eacbb067d41: Status 404 returned error can't find the container with id 73f17c8b752204ae6eb338904ca999d6061542315ced5f1184f43eacbb067d41 Jun 11 18:43:14.592342 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.592299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:14.875566 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:14.875527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:15.187364 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:15.187287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:15.323701 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:15.323665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" event={"ID":"b23be42a-33c0-40a4-9668-9f8f4165a29f","Type":"ContainerStarted","Data":"73f17c8b752204ae6eb338904ca999d6061542315ced5f1184f43eacbb067d41"} Jun 11 18:43:17.335201 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:17.335165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" event={"ID":"b23be42a-33c0-40a4-9668-9f8f4165a29f","Type":"ContainerStarted","Data":"bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda"} Jun 11 18:43:17.335686 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:17.335263 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:17.358457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:17.358392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" podStartSLOduration=1.002661746 podStartE2EDuration="3.358376687s" totalImagesPullingTime="2.355714941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:17.357409825 +0000 UTC m=+402.310212261" watchObservedRunningTime="2026-06-11 18:43:17.358376687 +0000 UTC m=+402.311179081" Jun 11 18:43:18.160482 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.160447 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc"] Jun 11 18:43:18.168134 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.168113 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:18.171393 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.171374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nkmmt\"" Jun 11 18:43:18.177424 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.177398 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc"] Jun 11 18:43:18.251391 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.251356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69dj\" (UniqueName: \"kubernetes.io/projected/1eea814c-5de9-400c-9357-643f6025f3ad-kube-api-access-v69dj\") pod \"authorino-operator-75cc8d5cb7-zwwcc\" (UID: \"1eea814c-5de9-400c-9357-643f6025f3ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:18.352604 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.352571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69dj\" (UniqueName: \"kubernetes.io/projected/1eea814c-5de9-400c-9357-643f6025f3ad-kube-api-access-v69dj\") pod \"authorino-operator-75cc8d5cb7-zwwcc\" (UID: \"1eea814c-5de9-400c-9357-643f6025f3ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:18.364699 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.364663 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69dj\" (UniqueName: \"kubernetes.io/projected/1eea814c-5de9-400c-9357-643f6025f3ad-kube-api-access-v69dj\") pod \"authorino-operator-75cc8d5cb7-zwwcc\" (UID: \"1eea814c-5de9-400c-9357-643f6025f3ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:18.479055 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.478973 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:18.580930 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.580871 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:18.611394 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:18.611371 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc"] Jun 11 18:43:18.613906 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:43:18.613880 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eea814c_5de9_400c_9357_643f6025f3ad.slice/crio-79214b8b3899d0fe8fd5f65c933c84da9f82a75061b186e8533a17f984cbd273 WatchSource:0}: Error finding container 79214b8b3899d0fe8fd5f65c933c84da9f82a75061b186e8533a17f984cbd273: Status 404 returned error can't find the container with id 79214b8b3899d0fe8fd5f65c933c84da9f82a75061b186e8533a17f984cbd273 Jun 11 18:43:19.346701 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:19.346662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" event={"ID":"1eea814c-5de9-400c-9357-643f6025f3ad","Type":"ContainerStarted","Data":"79214b8b3899d0fe8fd5f65c933c84da9f82a75061b186e8533a17f984cbd273"} Jun 11 18:43:19.635451 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:19.635368 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:19.732987 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:19.732941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:21.358913 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:21.358869 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" event={"ID":"1eea814c-5de9-400c-9357-643f6025f3ad","Type":"ContainerStarted","Data":"82cfdfa626e430682b9bc836cb80d3a27a2ad1db363247e06be0ba9d7e3a459c"} Jun 11 18:43:21.359355 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:21.359018 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:21.382566 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:21.382523 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" podStartSLOduration=1.018300362 podStartE2EDuration="3.382508964s" totalImagesPullingTime="2.364208602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:21.380635562 +0000 UTC m=+406.333437982" watchObservedRunningTime="2026-06-11 18:43:21.382508964 +0000 UTC m=+406.335311359" Jun 11 18:43:21.654344 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:21.654262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:23.433391 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:23.433362 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:24.319750 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:24.319717 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ksb9h" Jun 11 18:43:24.816137 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:24.816103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:24.936574 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:24.936544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:28.342101 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:28.342074 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:28.802300 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:28.802265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:28.903850 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:28.903814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:32.367529 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:32.367503 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zwwcc" Jun 11 18:43:32.821592 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:32.821563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:32.925189 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:32.925148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:33.186182 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:33.186098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:33.286411 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:33.286379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:33.385362 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:33.385328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:33.623122 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:33.623098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:36.586302 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:36.586266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:36.687218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:36.687186 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:43.225175 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.225124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:43.327371 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.327340 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:43.613915 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.613875 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl"] Jun 11 18:43:43.618258 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.618235 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.620944 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.620920 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4xmkb\"" Jun 11 18:43:43.629869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.629849 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl"] Jun 11 18:43:43.768327 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.768295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6x6\" (UniqueName: \"kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.768480 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.768339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.869056 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.868969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6x6\" (UniqueName: \"kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.869056 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.869014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.869402 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.869386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.879639 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.879614 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6x6\" (UniqueName: \"kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:43.928801 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:43.928772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:44.066674 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.066619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl"] Jun 11 18:43:44.071159 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:43:44.071133 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a446ed_2eb3_4d0a_a5ab_ba219340ff32.slice/crio-2c5b5c19bb437e4b1c76c73468c794db84f1c0bdb7995c04868aae066b8e39f0 WatchSource:0}: Error finding container 2c5b5c19bb437e4b1c76c73468c794db84f1c0bdb7995c04868aae066b8e39f0: Status 404 returned error can't find the container with id 2c5b5c19bb437e4b1c76c73468c794db84f1c0bdb7995c04868aae066b8e39f0 Jun 11 18:43:44.125495 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.125404 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl"] Jun 11 18:43:44.133098 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.133056 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl"] Jun 11 18:43:44.195511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.195479 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd"] Jun 11 18:43:44.195744 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.195720 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" containerName="manager" containerID="cri-o://bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda" gracePeriod=2 Jun 11 18:43:44.202174 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.202146 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd"] Jun 11 18:43:44.227291 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.227262 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x"] Jun 11 18:43:44.227783 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.227764 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" containerName="manager" Jun 11 18:43:44.227866 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.227785 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" containerName="manager" Jun 11 18:43:44.227918 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.227892 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" containerName="manager" Jun 11 18:43:44.229775 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.229751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:44.232691 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:44.232640 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:44.244833 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.244808 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x"] Jun 11 18:43:44.373091 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.373064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m78\" (UniqueName: \"kubernetes.io/projected/e3e554b2-82d8-4a2e-84d6-e87b97551e8c-kube-api-access-74m78\") pod \"limitador-operator-controller-manager-859d7b78bd-cvm7x\" (UID: \"e3e554b2-82d8-4a2e-84d6-e87b97551e8c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:44.424064 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.424041 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:44.426330 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:44.426305 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:44.470285 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.470259 2567 generic.go:356] "Generic (PLEG): container finished" podID="b23be42a-33c0-40a4-9668-9f8f4165a29f" containerID="bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda" exitCode=0 Jun 11 18:43:44.470392 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.470304 2567 scope.go:117] "RemoveContainer" containerID="bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda" Jun 11 18:43:44.470392 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.470305 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:44.473033 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:44.473008 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:44.474312 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.474292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74m78\" (UniqueName: \"kubernetes.io/projected/e3e554b2-82d8-4a2e-84d6-e87b97551e8c-kube-api-access-74m78\") pod \"limitador-operator-controller-manager-859d7b78bd-cvm7x\" (UID: \"e3e554b2-82d8-4a2e-84d6-e87b97551e8c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:44.478309 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.478291 2567 scope.go:117] "RemoveContainer" containerID="bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda" Jun 11 18:43:44.478556 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:44.478540 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda\": container with ID starting with bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda not found: ID does not exist" containerID="bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda" Jun 11 18:43:44.478602 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.478565 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda"} err="failed to get container status \"bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda\": rpc error: code = NotFound desc = could not find container \"bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda\": container with ID starting with bf9633c7ce25cecd21cde704d57f581e1810ecfe8bdd0b3fd212bbdd3239ffda not found: ID does not exist" Jun 11 18:43:44.482838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.482815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m78\" (UniqueName: \"kubernetes.io/projected/e3e554b2-82d8-4a2e-84d6-e87b97551e8c-kube-api-access-74m78\") pod \"limitador-operator-controller-manager-859d7b78bd-cvm7x\" (UID: \"e3e554b2-82d8-4a2e-84d6-e87b97551e8c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:44.575060 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.575028 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grtkq\" (UniqueName: \"kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq\") pod \"b23be42a-33c0-40a4-9668-9f8f4165a29f\" (UID: \"b23be42a-33c0-40a4-9668-9f8f4165a29f\") " Jun 11 18:43:44.575720 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.575695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:44.577501 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.577460 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq" (OuterVolumeSpecName: "kube-api-access-grtkq") pod "b23be42a-33c0-40a4-9668-9f8f4165a29f" (UID: "b23be42a-33c0-40a4-9668-9f8f4165a29f"). InnerVolumeSpecName "kube-api-access-grtkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:44.676675 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.676577 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grtkq\" (UniqueName: \"kubernetes.io/projected/b23be42a-33c0-40a4-9668-9f8f4165a29f-kube-api-access-grtkq\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:43:44.736855 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:44.736824 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x"] Jun 11 18:43:44.738067 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:43:44.738041 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e554b2_82d8_4a2e_84d6_e87b97551e8c.slice/crio-9054a10a6cac6f0390b24db6e215d0359fd14a7cd42289c825ba84aa61cc879b WatchSource:0}: Error finding container 9054a10a6cac6f0390b24db6e215d0359fd14a7cd42289c825ba84aa61cc879b: Status 404 returned error can't find the container with id 9054a10a6cac6f0390b24db6e215d0359fd14a7cd42289c825ba84aa61cc879b Jun 11 18:43:44.785395 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:44.785343 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:45.456118 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:45.456082 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2qsd\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2qsd" Jun 11 18:43:45.457836 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:45.457816 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b23be42a-33c0-40a4-9668-9f8f4165a29f" path="/var/lib/kubelet/pods/b23be42a-33c0-40a4-9668-9f8f4165a29f/volumes" Jun 11 18:43:45.477068 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:45.477037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" event={"ID":"e3e554b2-82d8-4a2e-84d6-e87b97551e8c","Type":"ContainerStarted","Data":"3b00a97f421c44e41985b9fcad0bdda7a39ac7793813eebc4f2121f037882ccf"} Jun 11 18:43:45.477218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:45.477095 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:43:45.477218 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:45.477118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" event={"ID":"e3e554b2-82d8-4a2e-84d6-e87b97551e8c","Type":"ContainerStarted","Data":"9054a10a6cac6f0390b24db6e215d0359fd14a7cd42289c825ba84aa61cc879b"} Jun 11 18:43:45.502011 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:45.501955 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" podStartSLOduration=1.501934681 podStartE2EDuration="1.501934681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:45.500836327 +0000 UTC m=+430.453638722" watchObservedRunningTime="2026-06-11 18:43:45.501934681 +0000 UTC m=+430.454737076" Jun 11 18:43:46.059356 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:46.059300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:46.159900 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:46.159865 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:48.495032 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.494942 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" containerName="manager" containerID="cri-o://39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc" gracePeriod=2 Jun 11 18:43:48.731511 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.731490 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:48.734561 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:48.734537 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:48.811142 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.811111 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume\") pod \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " Jun 11 18:43:48.811327 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.811183 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft6x6\" (UniqueName: \"kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6\") pod \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\" (UID: \"a8a446ed-2eb3-4d0a-a5ab-ba219340ff32\") " Jun 11 18:43:48.811391 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.811372 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" (UID: "a8a446ed-2eb3-4d0a-a5ab-ba219340ff32"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:43:48.813335 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.813315 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6" (OuterVolumeSpecName: "kube-api-access-ft6x6") pod "a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" (UID: "a8a446ed-2eb3-4d0a-a5ab-ba219340ff32"). InnerVolumeSpecName "kube-api-access-ft6x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:48.912130 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.912105 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-extensions-socket-volume\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:43:48.912130 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:48.912127 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft6x6\" (UniqueName: \"kubernetes.io/projected/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32-kube-api-access-ft6x6\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 18:43:49.462989 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.458410 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" path="/var/lib/kubelet/pods/a8a446ed-2eb3-4d0a-a5ab-ba219340ff32/volumes" Jun 11 18:43:49.500635 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.500604 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" containerID="39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc" exitCode=2 Jun 11 18:43:49.501012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.500667 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:49.501012 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.500684 2567 scope.go:117] "RemoveContainer" containerID="39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc" Jun 11 18:43:49.505004 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:49.504974 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ng9pl\" is forbidden: User \"system:node:ip-10-0-140-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-119.ec2.internal' and this object" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng9pl" Jun 11 18:43:49.508935 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.508917 2567 scope.go:117] "RemoveContainer" containerID="39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc" Jun 11 18:43:49.509214 ip-10-0-140-119 kubenswrapper[2567]: E0611 18:43:49.509194 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc\": container with ID starting with 39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc not found: ID does not exist" containerID="39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc" Jun 11 18:43:49.509283 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:49.509222 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc"} err="failed to get container status \"39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc\": rpc error: code = NotFound desc = could not find container \"39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc\": container with ID starting with 39be2b47b7cd0747ef52c9085f7052413b142c3edd77d45d78d32c543b9994dc not found: ID does not exist" Jun 11 18:43:50.843236 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:50.843201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:50.945429 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:50.945397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:51.043693 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:51.043621 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:54.390286 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:54.390192 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:54.489638 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:54.489597 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:56.486358 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:43:56.486330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cvm7x" Jun 11 18:44:00.466999 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:00.466961 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:01.018600 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:01.018564 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:01.126880 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:01.126844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:04.230298 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:04.230260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:04.331171 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:04.331137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:08.829371 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:08.829322 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:08.889773 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:08.889741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:09.019885 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:09.019854 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:09.083221 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:09.083139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:14.031615 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:14.031584 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:14.097449 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:14.097418 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:25.932338 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.932302 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4"] Jun 11 18:44:25.932863 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.932844 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" containerName="manager" Jun 11 18:44:25.932943 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.932865 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" containerName="manager" Jun 11 18:44:25.932986 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.932944 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a446ed-2eb3-4d0a-a5ab-ba219340ff32" containerName="manager" Jun 11 18:44:25.935700 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.935680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:25.938340 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.938315 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l7v9m\"" Jun 11 18:44:25.948393 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.948368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4"] Jun 11 18:44:25.962830 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:25.962802 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:26.015712 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.015882 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.015882 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.015882 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.016036 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.016036 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsp2n\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-kube-api-access-gsp2n\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.016036 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.016036 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.015997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.016181 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.016041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.080223 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.080181 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:26.117532 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117532 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsp2n\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-kube-api-access-gsp2n\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117809 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117887 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.117971 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118125 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118125 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.117986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118233 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.118133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118233 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.118160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118388 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.118365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.118731 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.118706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.120096 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.120077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.120734 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.120714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.127057 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.127030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.127381 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.127359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsp2n\" (UniqueName: \"kubernetes.io/projected/b107eaa1-89e6-4491-bc76-4434c8e8ff60-kube-api-access-gsp2n\") pod \"maas-default-gateway-openshift-default-687ff6996-qs4f4\" (UID: \"b107eaa1-89e6-4491-bc76-4434c8e8ff60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.246731 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.246625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:26.415586 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.415560 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4"] Jun 11 18:44:26.418137 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:44:26.418095 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb107eaa1_89e6_4491_bc76_4434c8e8ff60.slice/crio-b23763676488f36bc0f99c9db131da1172cff0a5e12ddb6340a0a4f07f696268 WatchSource:0}: Error finding container b23763676488f36bc0f99c9db131da1172cff0a5e12ddb6340a0a4f07f696268: Status 404 returned error can't find the container with id b23763676488f36bc0f99c9db131da1172cff0a5e12ddb6340a0a4f07f696268 Jun 11 18:44:26.420333 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.420298 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:44:26.420433 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.420367 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:44:26.420433 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.420396 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:44:26.665480 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.665448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" event={"ID":"b107eaa1-89e6-4491-bc76-4434c8e8ff60","Type":"ContainerStarted","Data":"00ee4c3f0d3c9222f5020cd8adece6280afcbd4c18da90b5ceba1a94e24b1018"} Jun 11 18:44:26.665669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.665507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" event={"ID":"b107eaa1-89e6-4491-bc76-4434c8e8ff60","Type":"ContainerStarted","Data":"b23763676488f36bc0f99c9db131da1172cff0a5e12ddb6340a0a4f07f696268"} Jun 11 18:44:26.687399 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:26.687337 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" podStartSLOduration=1.6873149330000001 podStartE2EDuration="1.687314933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:44:26.685912814 +0000 UTC m=+471.638715229" watchObservedRunningTime="2026-06-11 18:44:26.687314933 +0000 UTC m=+471.640117327" Jun 11 18:44:27.247327 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:27.247291 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:27.251727 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:27.251705 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:27.670457 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:27.670335 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:27.671346 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:27.671326 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:44:40.499134 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.499098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:40.603930 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.603895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:40.710320 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.710272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:40.922685 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.922635 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:44:40.927242 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.927221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:40.929713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.929691 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 18:44:40.929838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.929722 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pz7qv\"" Jun 11 18:44:40.936172 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.936147 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:44:40.974298 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:40.974260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:44:41.049641 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.049603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd042fd-b055-42c6-8a5e-90deb89674ee-config-file\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.049838 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.049675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqgm\" (UniqueName: \"kubernetes.io/projected/acd042fd-b055-42c6-8a5e-90deb89674ee-kube-api-access-ggqgm\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.150585 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.150545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd042fd-b055-42c6-8a5e-90deb89674ee-config-file\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.150807 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.150596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqgm\" (UniqueName: \"kubernetes.io/projected/acd042fd-b055-42c6-8a5e-90deb89674ee-kube-api-access-ggqgm\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.151234 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.151212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd042fd-b055-42c6-8a5e-90deb89674ee-config-file\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.159627 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.159595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqgm\" (UniqueName: \"kubernetes.io/projected/acd042fd-b055-42c6-8a5e-90deb89674ee-kube-api-access-ggqgm\") pod \"limitador-limitador-54d6d988d5-s7s7r\" (UID: \"acd042fd-b055-42c6-8a5e-90deb89674ee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.241380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.241286 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:41.358023 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.357978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:41.379907 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.379884 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:44:41.382114 ip-10-0-140-119 kubenswrapper[2567]: W0611 18:44:41.382084 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd042fd_b055_42c6_8a5e_90deb89674ee.slice/crio-f3feccc413b10c61981efa987da5937681f9c87323a8abd64fbaac5c020680ac WatchSource:0}: Error finding container f3feccc413b10c61981efa987da5937681f9c87323a8abd64fbaac5c020680ac: Status 404 returned error can't find the container with id f3feccc413b10c61981efa987da5937681f9c87323a8abd64fbaac5c020680ac Jun 11 18:44:41.455348 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.455316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:44:41.749423 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:41.749386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" event={"ID":"acd042fd-b055-42c6-8a5e-90deb89674ee","Type":"ContainerStarted","Data":"f3feccc413b10c61981efa987da5937681f9c87323a8abd64fbaac5c020680ac"} Jun 11 18:44:44.765780 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:44.765747 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" event={"ID":"acd042fd-b055-42c6-8a5e-90deb89674ee","Type":"ContainerStarted","Data":"909add987bb823c0c67c45aba68858ad66648927517888805760839bfd313a28"} Jun 11 18:44:44.766150 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:44.765870 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:44.784376 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:44.784321 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" podStartSLOduration=2.200780801 podStartE2EDuration="4.784306946s" totalImagesPullingTime="2.583526145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:44:44.783831175 +0000 UTC m=+489.736633581" watchObservedRunningTime="2026-06-11 18:44:44.784306946 +0000 UTC m=+489.737109340" Jun 11 18:44:55.771960 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:55.771931 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7s7r" Jun 11 18:44:59.314421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:44:59.314380 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:08.938422 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:08.938382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:09.037113 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:09.037067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:09.351713 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:09.351679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:40.757786 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:40.757749 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:40.860620 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:40.860577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:49.486681 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:49.486628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:49.586510 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:49.586472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:50.219749 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:50.219712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:56.435234 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:56.435199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:56.536250 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:45:56.536210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:10.303882 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:10.303848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:11.315401 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:11.315368 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:16.150323 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:16.150287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:16.252279 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:16.252233 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:16.305244 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:16.305215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:16.509337 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:16.509245 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:19.581567 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:19.581531 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:19.701750 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:19.701713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:35.430176 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:35.430150 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:46:35.430925 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:35.430892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:46:50.558220 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:50.558187 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:50.733597 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:50.733550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:50.987416 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:50.987325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:51.069756 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:51.069724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:51.256897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:51.256806 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:46:58.688585 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:58.688050 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qs4f4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 18:46:58.688585 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:58.688115 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" podUID="b107eaa1-89e6-4491-bc76-4434c8e8ff60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 18:46:59.391021 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.390984 2567 generic.go:356] "Generic (PLEG): container finished" podID="b107eaa1-89e6-4491-bc76-4434c8e8ff60" containerID="00ee4c3f0d3c9222f5020cd8adece6280afcbd4c18da90b5ceba1a94e24b1018" exitCode=0 Jun 11 18:46:59.391198 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.391059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" event={"ID":"b107eaa1-89e6-4491-bc76-4434c8e8ff60","Type":"ContainerDied","Data":"00ee4c3f0d3c9222f5020cd8adece6280afcbd4c18da90b5ceba1a94e24b1018"} Jun 11 18:46:59.391474 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.391460 2567 scope.go:117] "RemoveContainer" containerID="00ee4c3f0d3c9222f5020cd8adece6280afcbd4c18da90b5ceba1a94e24b1018" Jun 11 18:46:59.392531 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.392502 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:46:59.392608 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.392587 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:46:59.392670 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.392637 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 18:46:59.605770 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.605714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:59.702815 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:46:59.702716 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:00.400825 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:00.400781 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" event={"ID":"b107eaa1-89e6-4491-bc76-4434c8e8ff60","Type":"ContainerStarted","Data":"6474bf86a8c85bd41942900a746b2ad74a69b698211b67804cf8304bef182342"} Jun 11 18:47:01.247199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:01.247165 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:47:01.247641 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:01.247331 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qs4f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 11 18:47:01.247641 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:01.247384 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" podUID="b107eaa1-89e6-4491-bc76-4434c8e8ff60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 11 18:47:02.247472 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:02.247432 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qs4f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 11 18:47:02.247977 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:02.247497 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" podUID="b107eaa1-89e6-4491-bc76-4434c8e8ff60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 11 18:47:03.247839 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:03.247810 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qs4f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 11 18:47:03.248195 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:03.247865 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" podUID="b107eaa1-89e6-4491-bc76-4434c8e8ff60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 11 18:47:04.253818 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:04.253788 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:47:04.254186 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:04.254033 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:47:04.254847 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:04.254831 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qs4f4" Jun 11 18:47:27.271049 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:27.271013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:27.333020 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:27.332983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:49.378314 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:49.378279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:49.483173 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:47:49.483139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:48:00.087836 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:48:00.087798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:48:00.141553 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:48:00.141525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:48:58.773208 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:48:58.773125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:49:43.183379 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:49:43.183346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:49:43.281581 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:49:43.281530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:49:59.488190 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:49:59.488110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:49:59.807063 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:49:59.807028 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:50:07.360053 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:07.360017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:50:07.892105 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:07.892068 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:50:14.088421 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:14.088379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:50:14.795212 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:14.795170 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:50:34.065271 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:34.065233 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:50:34.991164 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:34.991129 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:50:39.685480 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:39.685446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:50:40.592402 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:50:40.592362 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:51:03.049769 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:51:03.049728 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:51:04.315276 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:51:04.315233 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:51:35.457396 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:51:35.457308 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:51:35.460518 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:51:35.460495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:51:41.412287 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:51:41.412252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:26.127336 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:26.127289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:38.239214 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:38.239166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:38.341669 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:38.341599 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:39.409165 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:39.409123 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:39.510207 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:39.510172 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:52:56.818428 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:52:56.818346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:53:11.092390 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:11.092348 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:53:20.392355 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:20.392311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:53:30.195909 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:30.195869 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:53:39.594822 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:39.594780 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:53:49.496783 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:49.496748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:53:58.297354 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:53:58.297317 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:54:06.487318 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:06.487284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:54:07.699062 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:07.699022 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:54:31.998820 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:31.998730 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:54:35.388044 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:35.388006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:54:47.671869 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:47.671831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:54:47.770990 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:47.770958 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:54:56.189894 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:54:56.189864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:55:01.917170 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:01.917134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:55:01.980499 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:01.980460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:55:11.288782 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:11.288740 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:55:27.284003 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:27.283964 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:55:34.151480 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:34.151444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:55:34.252287 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:34.252247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:55:58.155255 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:55:58.155159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:03.929612 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:03.929576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:03.985072 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:03.985048 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:04.063013 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:04.062983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:04.163276 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:04.163242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:04.289100 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:04.289056 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:04.389492 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:04.389454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:05.696932 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:05.696900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:56:20.837518 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:20.837473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:20.943897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:20.943865 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:21.044161 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:21.044127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:22.091960 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:22.091916 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:56:26.817418 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:26.817369 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:26.878096 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:26.878059 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:34.989019 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:34.988977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:35.081141 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:35.081114 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:35.184110 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:35.184076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:35.281310 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:35.281283 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:35.484292 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:35.484263 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:56:35.488179 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:35.488157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 18:56:37.001785 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:37.001629 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:56:51.801794 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:51.801745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:52.883063 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:52.883020 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:52.888527 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:52.888498 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:56:57.711840 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:57.711810 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:56:57.812866 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:56:57.812836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:01.979579 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:01.979535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:14.213065 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:14.213029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:14.309022 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:14.308993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:14.473813 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:14.473737 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:20.088199 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:20.088165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:20.193440 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:20.193396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:20.287897 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:20.287866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:20.453011 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:20.452914 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:26.335498 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:26.335426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:26.409066 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:26.409032 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:57:53.000935 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:57:53.000897 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:58:01.696812 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:01.696776 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:58:18.589326 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:18.589291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:58:22.776727 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:22.776688 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:58:27.087966 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:27.087931 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:58:44.397549 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:44.397511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:58:53.094623 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:58:53.094583 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:59:08.874233 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:08.874149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:59:08.974283 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:08.974240 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 18:59:25.289380 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:25.289341 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:59:34.298092 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:34.298061 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:59:43.191963 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:43.191925 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:59:50.494066 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:50.494030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 18:59:58.890623 ip-10-0-140-119 kubenswrapper[2567]: I0611 18:59:58.890584 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:00:00.142206 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.142168 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686740-n4gdn"] Jun 11 19:00:00.145699 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.145682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:00.148191 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.148174 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s5864\"" Jun 11 19:00:00.161328 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.161296 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686740-n4gdn"] Jun 11 19:00:00.210485 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.210443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmgv\" (UniqueName: \"kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv\") pod \"maas-api-key-cleanup-29686740-n4gdn\" (UID: \"f087401b-ee0d-4721-991c-042599676048\") " pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:00.311605 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.311564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmgv\" (UniqueName: \"kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv\") pod \"maas-api-key-cleanup-29686740-n4gdn\" (UID: \"f087401b-ee0d-4721-991c-042599676048\") " pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:00.320067 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.320040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmgv\" (UniqueName: \"kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv\") pod \"maas-api-key-cleanup-29686740-n4gdn\" (UID: \"f087401b-ee0d-4721-991c-042599676048\") " pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:00.456013 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.455938 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:00.588205 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.588091 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686740-n4gdn"] Jun 11 19:00:00.590903 ip-10-0-140-119 kubenswrapper[2567]: W0611 19:00:00.590868 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf087401b_ee0d_4721_991c_042599676048.slice/crio-d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f WatchSource:0}: Error finding container d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f: Status 404 returned error can't find the container with id d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f Jun 11 19:00:00.593002 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:00.592984 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:00:01.030197 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:01.030161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" event={"ID":"f087401b-ee0d-4721-991c-042599676048","Type":"ContainerStarted","Data":"d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f"} Jun 11 19:00:07.595090 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:07.595052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:00:11.502368 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:11.502331 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:00:13.097371 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:13.097336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" event={"ID":"f087401b-ee0d-4721-991c-042599676048","Type":"ContainerStarted","Data":"4788fb2b0d2a479f95b502ee98199411c9562a794c46184df4a92e4d57c52cd9"} Jun 11 19:00:14.103011 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.102975 2567 generic.go:356] "Generic (PLEG): container finished" podID="f087401b-ee0d-4721-991c-042599676048" containerID="4788fb2b0d2a479f95b502ee98199411c9562a794c46184df4a92e4d57c52cd9" exitCode=0 Jun 11 19:00:14.103442 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.103058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" event={"ID":"f087401b-ee0d-4721-991c-042599676048","Type":"ContainerDied","Data":"4788fb2b0d2a479f95b502ee98199411c9562a794c46184df4a92e4d57c52cd9"} Jun 11 19:00:14.233238 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.233213 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:14.334537 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.334494 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kmgv\" (UniqueName: \"kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv\") pod \"f087401b-ee0d-4721-991c-042599676048\" (UID: \"f087401b-ee0d-4721-991c-042599676048\") " Jun 11 19:00:14.336631 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.336603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv" (OuterVolumeSpecName: "kube-api-access-6kmgv") pod "f087401b-ee0d-4721-991c-042599676048" (UID: "f087401b-ee0d-4721-991c-042599676048"). InnerVolumeSpecName "kube-api-access-6kmgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:00:14.435399 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:14.435303 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kmgv\" (UniqueName: \"kubernetes.io/projected/f087401b-ee0d-4721-991c-042599676048-kube-api-access-6kmgv\") on node \"ip-10-0-140-119.ec2.internal\" DevicePath \"\"" Jun 11 19:00:15.109841 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:15.109814 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" Jun 11 19:00:15.109841 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:15.109821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686740-n4gdn" event={"ID":"f087401b-ee0d-4721-991c-042599676048","Type":"ContainerDied","Data":"d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f"} Jun 11 19:00:15.110264 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:15.109867 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d43d532d0f477f086d3eac74432c69cef2eb4465f4a048e9f872846d0fa69e3f" Jun 11 19:00:24.396670 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:24.396570 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:00:38.091243 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:00:38.091203 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:06.202524 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:06.202485 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:08.711022 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:08.710989 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:10.674941 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:10.674910 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:01:10.734040 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:10.734007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:01:23.857520 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:23.857488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:01:23.911001 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:23.910973 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:01:26.787626 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:26.787585 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:33.394515 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:33.394476 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:35.517778 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:35.517751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:01:35.523333 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:35.523314 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:01:52.703001 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:52.702965 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:01:57.594256 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:01:57.594176 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:01.289718 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:01.289682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:11.391843 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:11.391796 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:18.995448 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:18.995403 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:29.091600 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:29.091562 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:36.886705 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:36.886663 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:46.489951 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:46.489917 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:02:53.988905 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:02:53.988869 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:03:02.091318 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:03:02.091275 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:03:10.196969 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:03:10.196929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:05:17.935329 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.935290 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6"] Jun 11 19:05:17.935915 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.935673 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f087401b-ee0d-4721-991c-042599676048" containerName="cleanup" Jun 11 19:05:17.935915 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.935688 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f087401b-ee0d-4721-991c-042599676048" containerName="cleanup" Jun 11 19:05:17.935915 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.935764 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f087401b-ee0d-4721-991c-042599676048" containerName="cleanup" Jun 11 19:05:17.938925 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.938905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:17.941996 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.941978 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4xmkb\"" Jun 11 19:05:17.953619 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.953592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6"] Jun 11 19:05:17.961012 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.960988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hjn\" (UniqueName: \"kubernetes.io/projected/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-kube-api-access-z2hjn\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:17.961126 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:17.961039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.062014 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.061979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hjn\" (UniqueName: \"kubernetes.io/projected/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-kube-api-access-z2hjn\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.062172 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.062038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.062373 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.062352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.071541 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.071513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hjn\" (UniqueName: \"kubernetes.io/projected/1f77c9d9-cb37-4237-9f0f-0f591b03c41b-kube-api-access-z2hjn\") pod \"kuadrant-operator-controller-manager-86878c769f-8qnt6\" (UID: \"1f77c9d9-cb37-4237-9f0f-0f591b03c41b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.249457 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.249361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.401242 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.401044 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6"] Jun 11 19:05:18.403499 ip-10-0-140-119 kubenswrapper[2567]: W0611 19:05:18.403472 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f77c9d9_cb37_4237_9f0f_0f591b03c41b.slice/crio-9aa4fa98f29c555e0e65ff44d6aa2011c9cb04cfcc487a1843ef43f0761e196e WatchSource:0}: Error finding container 9aa4fa98f29c555e0e65ff44d6aa2011c9cb04cfcc487a1843ef43f0761e196e: Status 404 returned error can't find the container with id 9aa4fa98f29c555e0e65ff44d6aa2011c9cb04cfcc487a1843ef43f0761e196e Jun 11 19:05:18.516103 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.516058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" event={"ID":"1f77c9d9-cb37-4237-9f0f-0f591b03c41b","Type":"ContainerStarted","Data":"979d2a800676db665bd73202ac90baa8bfada6057ffbed56da50a2139901d2ed"} Jun 11 19:05:18.516303 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.516172 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" event={"ID":"1f77c9d9-cb37-4237-9f0f-0f591b03c41b","Type":"ContainerStarted","Data":"9aa4fa98f29c555e0e65ff44d6aa2011c9cb04cfcc487a1843ef43f0761e196e"} Jun 11 19:05:18.516500 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.516475 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:18.537612 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:18.537567 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" podStartSLOduration=1.537552472 podStartE2EDuration="1.537552472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:05:18.535958813 +0000 UTC m=+1723.488761207" watchObservedRunningTime="2026-06-11 19:05:18.537552472 +0000 UTC m=+1723.490354897" Jun 11 19:05:29.523923 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:29.523893 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qnt6" Jun 11 19:05:38.542207 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:38.542162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:05:42.641661 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:42.641607 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:05:56.829492 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:05:56.829453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:06:07.746558 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:07.746518 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:11.446455 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:11.446420 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:19.549321 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:19.549285 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:29.843919 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:29.843880 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:35.547806 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:35.547771 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:06:35.555786 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:35.555756 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:06:39.040506 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:39.040468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:49.844786 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:49.844750 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:06:58.548893 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:06:58.548857 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:07:08.846503 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:08.846468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:07:18.145846 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:18.145811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:07:27.850314 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:27.850276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:07:37.647965 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:37.647925 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:07:48.380664 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:48.380622 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:07:48.428783 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:07:48.428741 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:08:10.540935 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:08:10.540896 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:08:31.502775 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:08:31.502736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:08:31.554568 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:08:31.554532 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:08:53.657795 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:08:53.657755 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:02.744469 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:02.744429 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:11.056808 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:11.056771 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:20.063467 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:20.063429 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:28.342994 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:28.342914 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:38.839307 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:38.839270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:48.041528 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:48.041495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:09:53.146912 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:09:53.146875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:00.252009 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:00.251974 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:08.343454 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:08.343414 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:17.089578 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:17.089539 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:27.458437 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:27.458406 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:45.553032 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:45.552997 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:10:53.753088 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:10:53.753046 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:02.753864 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:02.753830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:10.758999 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:10.758962 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:13.561490 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:13.561453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:11:28.353325 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:28.353279 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:35.578136 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:35.578104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:11:35.584713 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:35.584691 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67cvn_9834d578-89cf-4069-8b1a-d3c05604129a/ovn-acl-logging/0.log" Jun 11 19:11:36.454474 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:36.449839 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:45.548440 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:45.548407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:11:53.943225 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:11:53.943184 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:02.949413 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:02.949375 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:11.338863 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:11.338824 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:20.551013 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:20.550976 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:31.447339 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:31.447301 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:40.849624 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:40.849589 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:12:51.238591 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:12:51.238554 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:00.941596 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:00.941556 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:06.148105 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:06.148059 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:13.950987 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:13.950948 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:19.047948 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:19.047909 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:33.855766 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.855734 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw"] Jun 11 19:13:33.859255 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.859239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:33.863146 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.863123 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 19:13:33.863269 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.863233 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 19:13:33.863269 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.863243 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 19:13:33.863269 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.863247 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 19:13:33.863447 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.863238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6s9xn\"" Jun 11 19:13:33.880363 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.880337 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw"] Jun 11 19:13:33.900747 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.900723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w87zj\" (UniqueName: \"kubernetes.io/projected/fa86c425-5b81-4eef-9126-5696814180a4-kube-api-access-w87zj\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:33.900880 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:33.900768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa86c425-5b81-4eef-9126-5696814180a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.001765 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.001735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w87zj\" (UniqueName: \"kubernetes.io/projected/fa86c425-5b81-4eef-9126-5696814180a4-kube-api-access-w87zj\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.001896 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.001782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa86c425-5b81-4eef-9126-5696814180a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.004341 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.004319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa86c425-5b81-4eef-9126-5696814180a4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.013199 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.013165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w87zj\" (UniqueName: \"kubernetes.io/projected/fa86c425-5b81-4eef-9126-5696814180a4-kube-api-access-w87zj\") pod \"managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw\" (UID: \"fa86c425-5b81-4eef-9126-5696814180a4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.168027 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.167940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" Jun 11 19:13:34.302100 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.302080 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw"] Jun 11 19:13:34.304385 ip-10-0-140-119 kubenswrapper[2567]: W0611 19:13:34.304351 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa86c425_5b81_4eef_9126_5696814180a4.slice/crio-52ea881c2a901eea30fbcf70d49c3640b3e15fc68f3a28d03b7c5f6bfb9a0436 WatchSource:0}: Error finding container 52ea881c2a901eea30fbcf70d49c3640b3e15fc68f3a28d03b7c5f6bfb9a0436: Status 404 returned error can't find the container with id 52ea881c2a901eea30fbcf70d49c3640b3e15fc68f3a28d03b7c5f6bfb9a0436 Jun 11 19:13:34.306175 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.306157 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:13:34.903910 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:34.903864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" event={"ID":"fa86c425-5b81-4eef-9126-5696814180a4","Type":"ContainerStarted","Data":"52ea881c2a901eea30fbcf70d49c3640b3e15fc68f3a28d03b7c5f6bfb9a0436"} Jun 11 19:13:35.951636 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:35.951602 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:36.918260 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:36.918161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" event={"ID":"fa86c425-5b81-4eef-9126-5696814180a4","Type":"ContainerStarted","Data":"f15dcdb0380ec71bb29b5b89410633782fe59308266a6e3b5f75be459f2f8b55"} Jun 11 19:13:36.934023 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:36.933956 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79b96c6b9b-pz4nw" podStartSLOduration=1.616082912 podStartE2EDuration="3.933936681s" totalImagesPullingTime="2.317853769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:13:36.932514135 +0000 UTC m=+2221.885316529" watchObservedRunningTime="2026-06-11 19:13:36.933936681 +0000 UTC m=+2221.886739076" Jun 11 19:13:44.545712 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:44.545672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:52.627660 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:52.627607 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:13:54.245604 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:54.245514 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:13:55.984539 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:55.984501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:13:58.639464 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.639429 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f"] Jun 11 19:13:58.648204 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.648182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.651172 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.651151 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 19:13:58.651296 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.651207 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 19:13:58.652318 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.652298 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 19:13:58.652454 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.652366 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 19:13:58.654673 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.654638 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f"] Jun 11 19:13:58.822387 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.822387 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.822585 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.822585 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr7c4\" (UniqueName: \"kubernetes.io/projected/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-kube-api-access-vr7c4\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.822585 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.822716 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.822595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923517 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923517 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923757 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923757 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923757 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.923757 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.923584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr7c4\" (UniqueName: \"kubernetes.io/projected/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-kube-api-access-vr7c4\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.924527 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.924495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.926003 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.925981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.926134 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.926081 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-ca\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.926236 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.926220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.926286 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.926220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.931901 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.931881 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr7c4\" (UniqueName: \"kubernetes.io/projected/f493a3b7-f7a2-48eb-b14d-cfe638f0225b-kube-api-access-vr7c4\") pod \"cluster-proxy-proxy-agent-7459cccfb8-qgc9f\" (UID: \"f493a3b7-f7a2-48eb-b14d-cfe638f0225b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:58.958861 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:58.958832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" Jun 11 19:13:59.098184 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:13:59.098069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f"] Jun 11 19:13:59.100618 ip-10-0-140-119 kubenswrapper[2567]: W0611 19:13:59.100592 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf493a3b7_f7a2_48eb_b14d_cfe638f0225b.slice/crio-a01d682313ff2d6279ef74eded32630d4354cf482c82380f92d1a6d2f7651e37 WatchSource:0}: Error finding container a01d682313ff2d6279ef74eded32630d4354cf482c82380f92d1a6d2f7651e37: Status 404 returned error can't find the container with id a01d682313ff2d6279ef74eded32630d4354cf482c82380f92d1a6d2f7651e37 Jun 11 19:14:00.033959 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:00.033919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" event={"ID":"f493a3b7-f7a2-48eb-b14d-cfe638f0225b","Type":"ContainerStarted","Data":"a01d682313ff2d6279ef74eded32630d4354cf482c82380f92d1a6d2f7651e37"} Jun 11 19:14:00.759326 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:00.759285 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:14:03.051009 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:03.050968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" event={"ID":"f493a3b7-f7a2-48eb-b14d-cfe638f0225b","Type":"ContainerStarted","Data":"faee950d574e1916642b443f0a6531d2960df3bf41da37678b32115a4e386540"} Jun 11 19:14:03.051009 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:03.051016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" event={"ID":"f493a3b7-f7a2-48eb-b14d-cfe638f0225b","Type":"ContainerStarted","Data":"dba4e2e099de8ea135856282d139815ff0656ce6570a3683c3b777010784de1b"} Jun 11 19:14:03.051537 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:03.051028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" event={"ID":"f493a3b7-f7a2-48eb-b14d-cfe638f0225b","Type":"ContainerStarted","Data":"db6bebe5b3de478a7d99433af0c8b2dfc7a6d45a2224ec8131ead1bd803881ae"} Jun 11 19:14:03.072030 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:03.071981 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7459cccfb8-qgc9f" podStartSLOduration=1.972022005 podStartE2EDuration="5.071965249s" totalImagesPullingTime="3.099943244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:14:03.070732463 +0000 UTC m=+2248.023534859" watchObservedRunningTime="2026-06-11 19:14:03.071965249 +0000 UTC m=+2248.024767686" Jun 11 19:14:20.242514 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:20.242473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:22.049639 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:22.049597 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:14:33.368159 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:33.368125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:34.066381 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:34.066345 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7s7r"] Jun 11 19:14:34.950159 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:34.950126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:35.056793 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:35.056758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:35.169532 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:35.169447 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:35.388723 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:35.388689 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:38.526691 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:38.526637 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:41.230559 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:41.230514 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:41.412858 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:41.412816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:41.513297 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:41.513257 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:43.078250 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:43.078212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:49.197166 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:49.197126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:49.430988 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:49.430951 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:49.679357 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:49.679319 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:49.884501 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:49.884417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:52.787714 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:52.787466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:55.852770 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:55.852729 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:57.069404 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:57.069367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:14:57.181666 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:14:57.181608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:00.571549 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:00.571510 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:05.772377 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:05.772338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:05.899194 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:05.899157 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:17.547416 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:17.547376 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fd5d586f-tkbf7_9be9ecf1-0a18-4d04-a293-3db8674fa53e/nginx/0.log" Jun 11 19:15:17.807774 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:17.807685 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-xsmrm_d3fa99e0-fc70-493d-bf6c-b65a4b0a967e/manager/0.log" Jun 11 19:15:18.062180 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:18.062097 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686740-n4gdn_f087401b-ee0d-4721-991c-042599676048/cleanup/0.log" Jun 11 19:15:18.607846 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:18.607817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dl259_b8437c75-e332-45b1-964f-8852114b9850/manager/0.log" Jun 11 19:15:18.738762 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:18.738730 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-2vwhf_806fcf64-f422-4a21-b45e-f11089184e69/copy-manifests/0.log" Jun 11 19:15:18.746731 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:18.746674 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-2vwhf_806fcf64-f422-4a21-b45e-f11089184e69/manager/0.log" Jun 11 19:15:20.757533 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:20.757499 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zwwcc_1eea814c-5de9-400c-9357-643f6025f3ad/manager/0.log" Jun 11 19:15:20.884601 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:20.884568 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ksb9h_75c2fb45-c275-430c-a69e-9df0ec7d81e8/manager/0.log" Jun 11 19:15:21.154888 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:21.154858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrwj6_870ab8bb-d4f7-4de1-a367-1b4f1ed2d133/registry-server/0.log" Jun 11 19:15:21.311262 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:21.311229 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8qnt6_1f77c9d9-cb37-4237-9f0f-0f591b03c41b/manager/0.log" Jun 11 19:15:21.455735 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:21.455637 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s7s7r_acd042fd-b055-42c6-8a5e-90deb89674ee/limitador/0.log" Jun 11 19:15:21.583743 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:21.583716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cvm7x_e3e554b2-82d8-4a2e-84d6-e87b97551e8c/manager/0.log" Jun 11 19:15:21.960487 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:21.960454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fflbt_7f4848c8-217d-46f0-ba95-59803361636c/istio-proxy/0.log" Jun 11 19:15:22.474951 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:22.474914 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/1.log" Jun 11 19:15:26.415388 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:26.415285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:28.959619 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:28.959575 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:29.080618 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:29.080563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:32.753630 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:32.753603 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x96t8_24977f59-bbbd-46e6-8455-a65836976c6f/global-pull-secret-syncer/0.log" Jun 11 19:15:32.879949 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:32.879915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" Jun 11 19:15:33.122880 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:33.122851 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-119.ec2.internal_08e45fe30cb4777b4725763e55e81d4a/haproxy/0.log" Jun 11 19:15:36.927138 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:36.927100 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-kdxfv_af857d38-44ac-42b8-b156-c27dc4e79102/sail-operator/0.log" Jun 11 19:15:37.900314 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:37.900285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zwwcc_1eea814c-5de9-400c-9357-643f6025f3ad/manager/0.log" Jun 11 19:15:37.927432 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:37.927403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ksb9h_75c2fb45-c275-430c-a69e-9df0ec7d81e8/manager/0.log" Jun 11 19:15:38.017343 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:38.017309 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrwj6_870ab8bb-d4f7-4de1-a367-1b4f1ed2d133/registry-server/0.log" Jun 11 19:15:38.112418 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:38.112377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8qnt6_1f77c9d9-cb37-4237-9f0f-0f591b03c41b/manager/0.log" Jun 11 19:15:38.139566 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:38.139538 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s7s7r_acd042fd-b055-42c6-8a5e-90deb89674ee/limitador/0.log" Jun 11 19:15:38.232777 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:38.232741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cvm7x_e3e554b2-82d8-4a2e-84d6-e87b97551e8c/manager/0.log" Jun 11 19:15:40.206597 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.206523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-z7lvg_954c1a24-a429-4aab-99a9-9a91319cf4bf/kube-state-metrics/0.log" Jun 11 19:15:40.251573 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.251544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-z7lvg_954c1a24-a429-4aab-99a9-9a91319cf4bf/kube-rbac-proxy-main/0.log" Jun 11 19:15:40.296710 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.296688 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-z7lvg_954c1a24-a429-4aab-99a9-9a91319cf4bf/kube-rbac-proxy-self/0.log" Jun 11 19:15:40.337674 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.337627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78fd5df87b-2rnmm_e9f69181-02f4-495e-8e2b-8d97574ce6da/metrics-server/0.log" Jun 11 19:15:40.390136 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.390110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-556pw_5ce0994a-db2b-499d-b9a6-b1b19c163a21/monitoring-plugin/0.log" Jun 11 19:15:40.889266 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.889226 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qxqbn_d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3/node-exporter/0.log" Jun 11 19:15:40.931692 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.931666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qxqbn_d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3/kube-rbac-proxy/0.log" Jun 11 19:15:40.969397 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:40.969372 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qxqbn_d7aff3c8-48a2-4a6d-8c0d-dd1192d7e5e3/init-textfile/0.log" Jun 11 19:15:41.008309 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.008280 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bxw6c_833cb9b5-10cb-412d-8fcd-f3280e0dd5b2/kube-rbac-proxy-main/0.log" Jun 11 19:15:41.052224 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.052189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bxw6c_833cb9b5-10cb-412d-8fcd-f3280e0dd5b2/kube-rbac-proxy-self/0.log" Jun 11 19:15:41.084035 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.084008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bxw6c_833cb9b5-10cb-412d-8fcd-f3280e0dd5b2/openshift-state-metrics/0.log" Jun 11 19:15:41.149743 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.149629 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/prometheus/0.log" Jun 11 19:15:41.188205 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.188166 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/config-reloader/0.log" Jun 11 19:15:41.226553 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.226522 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/thanos-sidecar/0.log" Jun 11 19:15:41.254462 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.254433 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/kube-rbac-proxy-web/0.log" Jun 11 19:15:41.291303 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.291276 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/kube-rbac-proxy/0.log" Jun 11 19:15:41.322417 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.322387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/kube-rbac-proxy-thanos/0.log" Jun 11 19:15:41.362504 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:41.362479 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a37e5af8-1491-44c7-a777-cac7a4dfb05a/init-config-reloader/0.log" Jun 11 19:15:44.522110 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.522076 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj"] Jun 11 19:15:44.525346 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.525329 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.528056 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.528031 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwsb7\"/\"kube-root-ca.crt\"" Jun 11 19:15:44.529046 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.529026 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fwsb7\"/\"default-dockercfg-74dfg\"" Jun 11 19:15:44.529124 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.529026 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwsb7\"/\"openshift-service-ca.crt\"" Jun 11 19:15:44.539160 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.539137 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj"] Jun 11 19:15:44.659363 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.659328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-sys\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.659363 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.659364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zt2\" (UniqueName: \"kubernetes.io/projected/c21f7651-5ec4-4185-a520-340a4f434d57-kube-api-access-n8zt2\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.659558 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.659452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-proc\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.659558 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.659489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-podres\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.659558 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.659512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-lib-modules\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760587 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-sys\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760587 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zt2\" (UniqueName: \"kubernetes.io/projected/c21f7651-5ec4-4185-a520-340a4f434d57-kube-api-access-n8zt2\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760823 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-proc\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760823 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-podres\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760823 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-lib-modules\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760823 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-sys\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.760823 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-proc\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.761026 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-podres\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.761026 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.760887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21f7651-5ec4-4185-a520-340a4f434d57-lib-modules\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.770309 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.770280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zt2\" (UniqueName: \"kubernetes.io/projected/c21f7651-5ec4-4185-a520-340a4f434d57-kube-api-access-n8zt2\") pod \"perf-node-gather-daemonset-m8stj\" (UID: \"c21f7651-5ec4-4185-a520-340a4f434d57\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.836361 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.836285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:44.971011 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:44.970986 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj"] Jun 11 19:15:44.973475 ip-10-0-140-119 kubenswrapper[2567]: W0611 19:15:44.973450 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc21f7651_5ec4_4185_a520_340a4f434d57.slice/crio-a3d4ac691f231a4a6508318c0986183382e5e304e5ea69314c21d10f81e6534c WatchSource:0}: Error finding container a3d4ac691f231a4a6508318c0986183382e5e304e5ea69314c21d10f81e6534c: Status 404 returned error can't find the container with id a3d4ac691f231a4a6508318c0986183382e5e304e5ea69314c21d10f81e6534c Jun 11 19:15:45.541928 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:45.541890 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" event={"ID":"c21f7651-5ec4-4185-a520-340a4f434d57","Type":"ContainerStarted","Data":"30b12736ca7ebdd44a1872b68879c86c33c07783e5bb297d298a466a3bc68046"} Jun 11 19:15:45.542318 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:45.541945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" event={"ID":"c21f7651-5ec4-4185-a520-340a4f434d57","Type":"ContainerStarted","Data":"a3d4ac691f231a4a6508318c0986183382e5e304e5ea69314c21d10f81e6534c"} Jun 11 19:15:45.542318 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:45.541989 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:45.559490 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:45.559448 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" podStartSLOduration=1.559435374 podStartE2EDuration="1.559435374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:15:45.55809463 +0000 UTC m=+2350.510897049" watchObservedRunningTime="2026-06-11 19:15:45.559435374 +0000 UTC m=+2350.512237769" Jun 11 19:15:46.274802 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:46.274770 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv2ct_6217a90d-93d9-4041-b84a-c4bd6cdb0050/dns/0.log" Jun 11 19:15:46.306947 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:46.306921 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hv2ct_6217a90d-93d9-4041-b84a-c4bd6cdb0050/kube-rbac-proxy/0.log" Jun 11 19:15:46.494927 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:46.494895 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cz27w_e7f407b2-cfd8-4565-af28-70616f6e1b95/dns-node-resolver/0.log" Jun 11 19:15:47.346556 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:47.346521 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-twpkn_90687bce-fed4-427e-906d-010c50f2e0b4/node-ca/0.log" Jun 11 19:15:48.490407 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:48.490374 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fflbt_7f4848c8-217d-46f0-ba95-59803361636c/istio-proxy/0.log" Jun 11 19:15:48.700627 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:48.700590 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/0.log" Jun 11 19:15:48.758340 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:48.758251 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/1.log" Jun 11 19:15:49.469494 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:49.469455 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cz4xx_428e54f8-d8db-4e06-8387-44a80d9e237d/konnectivity-agent/0.log" limit=1024 Jun 11 19:15:49.745615 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:49.745530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dl8rx_32c593b2-9245-45cf-8b0e-750f948e7d74/serve-healthcheck-canary/0.log" Jun 11 19:15:50.416116 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:50.416088 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnptq_d82e8019-a7bb-4387-ae86-15151a6f5e0b/kube-rbac-proxy/0.log" Jun 11 19:15:50.438025 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:50.437997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnptq_d82e8019-a7bb-4387-ae86-15151a6f5e0b/exporter/0.log" Jun 11 19:15:50.462236 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:50.462205 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnptq_d82e8019-a7bb-4387-ae86-15151a6f5e0b/extractor/0.log" Jun 11 19:15:51.557681 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:51.557632 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-m8stj" Jun 11 19:15:52.960586 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:52.960562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fd5d586f-tkbf7_9be9ecf1-0a18-4d04-a293-3db8674fa53e/nginx/0.log" Jun 11 19:15:53.122506 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:53.122471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-xsmrm_d3fa99e0-fc70-493d-bf6c-b65a4b0a967e/manager/0.log" Jun 11 19:15:53.189945 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:53.189915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686740-n4gdn_f087401b-ee0d-4721-991c-042599676048/cleanup/0.log" Jun 11 19:15:53.414041 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:53.414010 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dl259_b8437c75-e332-45b1-964f-8852114b9850/manager/0.log" Jun 11 19:15:53.441194 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:53.441168 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-2vwhf_806fcf64-f422-4a21-b45e-f11089184e69/manager/0.log" Jun 11 19:15:53.467480 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:53.467456 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-2vwhf_806fcf64-f422-4a21-b45e-f11089184e69/copy-manifests/0.log" Jun 11 19:15:55.422965 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:55.422929 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-657f978cc6-cct97_4e1c6914-45eb-44da-9393-5cf0ced88b0c/manager/0.log" Jun 11 19:15:57.809072 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:57.809045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fflbt_7f4848c8-217d-46f0-ba95-59803361636c/istio-proxy/0.log" Jun 11 19:15:57.925932 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:57.925898 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/0.log" Jun 11 19:15:57.984370 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:57.984343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/1.log" Jun 11 19:15:59.278046 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:59.278017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fflbt_7f4848c8-217d-46f0-ba95-59803361636c/istio-proxy/0.log" Jun 11 19:15:59.430874 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:59.430830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/0.log" Jun 11 19:15:59.491329 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:15:59.491291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/1.log" Jun 11 19:16:01.494619 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:16:01.494583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795fflbt_7f4848c8-217d-46f0-ba95-59803361636c/istio-proxy/0.log" Jun 11 19:16:01.617111 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:16:01.617076 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/0.log" Jun 11 19:16:01.677900 ip-10-0-140-119 kubenswrapper[2567]: I0611 19:16:01.677870 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qs4f4_b107eaa1-89e6-4491-bc76-4434c8e8ff60/istio-proxy/1.log"