Jun 10 17:03:58.450794 ip-10-0-141-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 17:03:58.450811 ip-10-0-141-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 17:03:58.450820 ip-10-0-141-107 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 17:03:58.451022 ip-10-0-141-107 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 17:04:08.472533 ip-10-0-141-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 17:04:08.472553 ip-10-0-141-107 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6dacde36ef6141338c8805f7c13b13c1 -- Jun 10 17:06:58.733942 ip-10-0-141-107 systemd[1]: Starting Kubernetes Kubelet... Jun 10 17:06:59.153319 ip-10-0-141-107 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:06:59.153319 ip-10-0-141-107 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 17:06:59.153319 ip-10-0-141-107 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:06:59.153319 ip-10-0-141-107 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 17:06:59.153979 ip-10-0-141-107 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:06:59.153979 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.153424 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 17:06:59.158132 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158116 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.158132 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158130 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158134 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158137 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158141 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158143 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158146 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158148 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158152 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158155 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158158 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158160 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158163 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158165 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158168 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158171 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158173 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158176 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158178 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158181 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.158198 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158186 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158190 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158193 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158196 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158199 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158202 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158206 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158210 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158213 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158216 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158221 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158223 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158226 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158228 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158231 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158233 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158236 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158238 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158241 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.158660 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158244 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158246 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158249 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158252 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158254 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158257 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158259 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158261 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158264 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158266 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158269 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158271 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158273 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158276 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158279 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158281 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158284 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158287 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158289 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158292 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.159140 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158294 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158297 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158299 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158302 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158304 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158306 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158309 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158312 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158314 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158321 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158323 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158326 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158328 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158330 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158333 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158335 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158338 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158340 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158343 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.159605 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158345 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158348 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158350 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158353 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158355 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158358 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158363 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158366 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158369 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158372 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158374 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158376 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158379 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158381 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158384 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158386 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158388 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158391 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.158394 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.160092 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160044 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160051 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160055 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160058 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160062 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160064 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160067 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160069 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160072 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160075 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160077 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160080 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160083 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160087 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160089 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160092 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160095 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160097 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160100 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160103 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.160564 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160106 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160109 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160111 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160114 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160116 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160119 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160121 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160123 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160126 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160128 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160131 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160133 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160136 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160138 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160142 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160145 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160149 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160153 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160156 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.161063 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160159 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160162 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160165 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160168 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160171 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160173 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160176 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160178 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160181 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160183 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160186 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160188 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160191 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160193 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160196 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160199 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160201 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160204 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160206 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160208 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.161509 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160211 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160213 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160216 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160219 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160222 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160224 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160227 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160230 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160232 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160235 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160238 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160240 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160242 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160245 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160247 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160250 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160252 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160255 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160257 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160260 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.162023 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160262 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160265 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160267 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160270 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160273 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160279 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160282 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160285 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160287 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160290 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160293 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160295 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160298 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160301 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160304 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160307 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160309 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160312 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.162519 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160315 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160668 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160673 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160676 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160679 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160682 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160684 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160687 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160689 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160692 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160694 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160697 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160699 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160702 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160704 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160706 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160709 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160712 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160714 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160717 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.163000 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160720 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160722 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160724 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160727 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160729 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160732 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160734 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160737 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160740 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160742 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160744 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160747 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160751 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160755 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160758 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160761 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160764 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160767 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160771 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160774 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.163480 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160776 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160778 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160781 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160783 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160786 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160788 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160790 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160793 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160796 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160799 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160801 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160803 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160806 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160810 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160813 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160816 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160818 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160822 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160824 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.163976 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160827 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160830 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160833 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160835 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160839 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160842 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160845 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160848 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160850 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160852 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160855 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160858 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160860 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160863 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160865 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160868 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160870 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160872 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160875 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.164431 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160877 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160880 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160882 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160884 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160887 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160889 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160892 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160894 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160896 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160899 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160901 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160904 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160906 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160909 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160911 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160914 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160916 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160921 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160924 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160926 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.164891 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160929 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.160931 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.160998 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161004 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161010 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161015 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161019 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161022 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161026 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161030 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161034 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161037 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161040 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161043 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161046 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161049 2559 flags.go:64] FLAG: --cgroup-root="" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161052 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161055 2559 flags.go:64] FLAG: --client-ca-file="" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161058 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161061 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161066 2559 flags.go:64] FLAG: --cluster-domain="" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161069 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161072 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161075 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 17:06:59.165395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161078 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161082 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161085 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161089 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161092 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161096 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161099 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161102 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161105 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161107 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161111 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161114 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161116 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161120 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161123 2559 flags.go:64] FLAG: --enable-server="true" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161125 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161129 2559 flags.go:64] FLAG: --event-burst="100" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161132 2559 flags.go:64] FLAG: --event-qps="50" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161135 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161137 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161140 2559 flags.go:64] FLAG: --eviction-hard="" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161144 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161146 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161149 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161152 2559 flags.go:64] FLAG: --eviction-soft="" Jun 10 17:06:59.165981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161155 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161158 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161160 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161163 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161166 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161169 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161171 2559 flags.go:64] FLAG: --feature-gates="" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161175 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161178 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161181 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161184 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161187 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161192 2559 flags.go:64] FLAG: --help="false" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161195 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161198 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161200 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161203 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161206 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161210 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161212 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161215 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161218 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161221 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 17:06:59.166575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161224 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161227 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161229 2559 flags.go:64] FLAG: --kube-reserved="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161232 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161235 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161238 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161240 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161243 2559 flags.go:64] FLAG: --lock-file="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161246 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161248 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161251 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161257 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161260 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161263 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161265 2559 flags.go:64] FLAG: --logging-format="text" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161268 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161271 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161273 2559 flags.go:64] FLAG: --manifest-url="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161276 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161280 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161282 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161289 2559 flags.go:64] FLAG: --max-pods="110" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161292 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161295 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161297 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 17:06:59.167228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161300 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161303 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161306 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161309 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161315 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161318 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161321 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161324 2559 flags.go:64] FLAG: --pod-cidr="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161327 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161332 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161334 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161337 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161340 2559 flags.go:64] FLAG: --port="10250" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161343 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161346 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079748f92c152e203" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161349 2559 flags.go:64] FLAG: --qos-reserved="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161352 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161354 2559 flags.go:64] FLAG: --register-node="true" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161357 2559 flags.go:64] FLAG: --register-with-taints="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161361 2559 flags.go:64] FLAG: --registry-burst="10" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161363 2559 flags.go:64] FLAG: --registry-qps="5" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161366 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161368 2559 flags.go:64] FLAG: --reserved-memory="" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161372 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161375 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 17:06:59.168205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161378 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161380 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161383 2559 flags.go:64] FLAG: --runonce="false" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161387 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161390 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161393 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161395 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161398 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161400 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161403 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161406 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161409 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161411 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161414 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161417 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161420 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161423 2559 flags.go:64] FLAG: --system-cgroups="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161425 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161430 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161433 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161436 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161440 2559 flags.go:64] FLAG: --tls-min-version="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161445 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161448 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161451 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 17:06:59.169230 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161453 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161456 2559 flags.go:64] FLAG: --v="2" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161460 2559 flags.go:64] FLAG: --version="false" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161464 2559 flags.go:64] FLAG: --vmodule="" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161467 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.161470 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161590 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161595 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161598 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161601 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161607 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161610 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161612 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161615 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161618 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161620 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161623 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161625 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161630 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161633 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161636 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.170079 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161639 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161642 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161645 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161661 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161665 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161669 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161673 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161675 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161679 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161682 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161684 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161687 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161689 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161693 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161697 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161701 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161704 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161707 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161710 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.170627 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161713 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161716 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161720 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161722 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161725 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161728 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161731 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161734 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161736 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161739 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161741 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161744 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161746 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161749 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161751 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161754 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161757 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161760 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161762 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161764 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.171120 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161767 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161770 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161773 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161775 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161778 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161781 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161783 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161786 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161788 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161791 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161793 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161796 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161798 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161801 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161805 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161807 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161810 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161812 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161815 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161818 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.171624 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161820 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161822 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161825 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161827 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161830 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161832 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161835 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161837 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161840 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161843 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161845 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161848 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161850 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161855 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161857 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161860 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161864 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161866 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161869 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.172110 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161871 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161874 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161876 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161879 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161881 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.161884 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.162428 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.170608 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.170623 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.171309 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.171328 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171394 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171399 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171402 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.172563 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171405 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171408 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171411 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171415 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171418 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171421 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171423 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171426 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171428 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171431 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171434 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171437 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171439 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171442 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171444 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171447 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171450 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171452 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171455 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.172926 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171458 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171461 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171463 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171466 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171468 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171471 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171480 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171483 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171485 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171488 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171490 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171493 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171496 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171499 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171501 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171504 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171506 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171509 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171512 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171514 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.173417 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171517 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171520 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171522 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171525 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171527 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171530 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171532 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171535 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171538 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171540 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171543 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171546 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171548 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171551 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171553 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171556 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171558 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171562 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171566 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171570 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.173963 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171573 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171576 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171579 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171582 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171585 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171589 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171593 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171596 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171598 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171601 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171604 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171606 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171609 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171612 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171616 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171618 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171621 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171625 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171628 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.174469 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171631 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171634 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171637 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171639 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171642 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171645 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171660 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171663 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171665 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171668 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171671 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171674 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171677 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171679 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171682 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171685 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171688 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.174998 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171690 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.171696 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171824 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171829 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171832 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171835 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171838 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171841 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171843 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171846 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171849 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171851 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171854 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171858 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:06:59.175409 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171862 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171866 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171869 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171873 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171876 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171878 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171881 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171884 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171887 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171890 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171892 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171895 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171897 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171900 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171903 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171905 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171908 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171911 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171913 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:06:59.175757 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171916 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171919 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171921 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171924 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171927 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171929 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171932 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171934 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171937 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171940 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171942 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171944 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171947 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171949 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171952 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171955 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171957 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171960 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171962 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171965 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:06:59.176244 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171967 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171970 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171972 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171974 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171977 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171979 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171982 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171985 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171988 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171990 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171995 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.171998 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172001 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172003 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172005 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172008 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172010 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172013 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172015 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:06:59.176734 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172017 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172020 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172022 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172025 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172027 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172030 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172032 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172035 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172037 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172042 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172045 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172048 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172051 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172053 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172055 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172058 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172060 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172063 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172065 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172068 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:06:59.177213 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172070 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172073 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172075 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172077 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172081 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172083 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172086 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:06:59.172088 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.172093 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.172195 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.174098 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.175312 2559 server.go:1019] "Starting client certificate rotation" Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.175409 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 17:06:59.177720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.175443 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 17:06:59.178203 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.178187 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 17:06:59.179480 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.179463 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 17:06:59.192450 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.192433 2559 log.go:25] "Validated CRI v1 runtime API" Jun 10 17:06:59.195701 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.195686 2559 log.go:25] "Validated CRI v1 image API" Jun 10 17:06:59.196484 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.196470 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 17:06:59.199723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.199702 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a8ef7501-40d3-4c9b-872e-1a764c326ba8:/dev/nvme0n1p3 b97eb216-937a-4c4a-8721-b38d7879cc1a:/dev/nvme0n1p4] Jun 10 17:06:59.199780 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.199723 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 17:06:59.204047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.204030 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 17:06:59.205525 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.205419 2559 manager.go:216] Machine: {Timestamp:2026-06-10 17:06:59.204265807 +0000 UTC m=+0.352812931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184103 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2893f9d1d5377c967581695a318002 SystemUUID:ec2893f9-d1d5-377c-9675-81695a318002 BootID:6dacde36-ef61-4133-8c88-05f7c13b13c1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:41:d7:69:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:41:d7:69:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:55:ff:44:de:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 17:06:59.205525 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.205513 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 17:06:59.205672 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.205609 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 17:06:59.206702 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.206675 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 17:06:59.206840 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.206707 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 17:06:59.207364 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.207354 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 17:06:59.207398 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.207367 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 17:06:59.207398 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.207374 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 17:06:59.208073 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.208063 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 17:06:59.208724 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.208715 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 17:06:59.211405 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211395 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 17:06:59.211509 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211500 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 17:06:59.211545 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211528 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 10 17:06:59.211545 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211536 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 17:06:59.211611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211548 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 17:06:59.211611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211557 2559 kubelet.go:398] "Adding apiserver pod source" Jun 10 17:06:59.211611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.211568 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 17:06:59.212037 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.212019 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 17:06:59.212078 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.212067 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 17:06:59.214874 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.214846 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 17:06:59.216846 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.216828 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 17:06:59.216923 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.216865 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 17:06:59.217940 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217927 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217944 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217950 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217956 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217967 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217974 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217981 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 17:06:59.217989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217986 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 17:06:59.218162 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217993 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 17:06:59.218162 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.217998 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 17:06:59.218162 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.218006 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 17:06:59.218162 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.218011 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 17:06:59.219700 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.219689 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 17:06:59.219700 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.219699 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 17:06:59.222395 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.222373 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 17:06:59.222999 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.222982 2559 server.go:1268] "Started kubelet" Jun 10 17:06:59.223092 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.223053 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 17:06:59.223148 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.223107 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 17:06:59.223198 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.223141 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 17:06:59.223198 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.223143 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 17:06:59.223289 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.223200 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 17:06:59.223862 ip-10-0-141-107 systemd[1]: Started Kubernetes Kubelet. Jun 10 17:06:59.224584 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.224546 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 17:06:59.225769 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.225756 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 10 17:06:59.229249 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.229234 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 17:06:59.229249 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.229243 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 17:06:59.229423 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.229400 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.229832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.229818 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 17:06:59.229955 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.229839 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsnxv" Jun 10 17:06:59.230044 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.229866 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 17:06:59.230044 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230044 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 17:06:59.230226 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230164 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 10 17:06:59.230226 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230173 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 10 17:06:59.230226 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230202 2559 factory.go:55] Registering systemd factory Jun 10 17:06:59.230226 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230218 2559 factory.go:223] Registration of the systemd container factory successfully Jun 10 17:06:59.230483 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230467 2559 factory.go:153] Registering CRI-O factory Jun 10 17:06:59.230550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230498 2559 factory.go:223] Registration of the crio container factory successfully Jun 10 17:06:59.230550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230543 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 17:06:59.230638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230562 2559 factory.go:103] Registering Raw factory Jun 10 17:06:59.230638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.230571 2559 manager.go:1196] Started watching for new ooms in manager Jun 10 17:06:59.232312 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.231244 2559 manager.go:349] Starting recovery of all containers Jun 10 17:06:59.233077 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.233044 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 17:06:59.233183 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.230455 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-107.ec2.internal.18b7c737973f4cc0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-107.ec2.internal,UID:ip-10-0-141-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-107.ec2.internal,},FirstTimestamp:2026-06-10 17:06:59.222957248 +0000 UTC m=+0.371504354,LastTimestamp:2026-06-10 17:06:59.222957248 +0000 UTC m=+0.371504354,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-107.ec2.internal,}" Jun 10 17:06:59.238680 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.238637 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsnxv" Jun 10 17:06:59.238959 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.238933 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 17:06:59.239231 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.239204 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 17:06:59.241775 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.241617 2559 manager.go:354] Recovery completed Jun 10 17:06:59.247470 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.247458 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.249072 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249057 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.249137 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249084 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.249137 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249094 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.249606 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249590 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 17:06:59.249606 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249599 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.249606 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249604 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 17:06:59.249797 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.249619 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 17:06:59.250305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250292 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.250372 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250314 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.250372 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250323 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.250583 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250571 2559 policy_none.go:49] "None policy: Start" Jun 10 17:06:59.250638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250589 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 17:06:59.250638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.250602 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 17:06:59.251061 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.251005 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-107.ec2.internal.18b7c73798cdc6a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-107.ec2.internal,UID:ip-10-0-141-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-107.ec2.internal,},FirstTimestamp:2026-06-10 17:06:59.249071782 +0000 UTC m=+0.397618890,LastTimestamp:2026-06-10 17:06:59.249071782 +0000 UTC m=+0.397618890,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-107.ec2.internal,}" Jun 10 17:06:59.251519 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.251508 2559 policy_none.go:47] "Start" Jun 10 17:06:59.286232 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286218 2559 manager.go:337] "Starting Device Plugin manager" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.286250 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286259 2559 server.go:87] "Starting device plugin registration server" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286455 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286467 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286567 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286638 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.286646 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.287097 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.287137 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.294530 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.295554 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.295586 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.295604 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 17:06:59.297182 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.295634 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 17:06:59.297790 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.297607 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:06:59.387181 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.387162 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.387873 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.387860 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.387933 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.387885 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.387933 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.387895 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.387933 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.387917 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.395912 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.395887 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal"] Jun 10 17:06:59.395998 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.395945 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.396053 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.396041 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.396099 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.396061 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-107.ec2.internal\": node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.396601 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.396588 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.396645 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.396612 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.396645 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.396621 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.397731 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.397720 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.397847 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.397834 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.397884 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.397862 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.398346 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398330 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.398346 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398353 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.398346 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398333 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.398495 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398362 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.398495 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398380 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.398495 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.398393 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.399298 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.399285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.399363 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.399306 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:06:59.399929 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.399912 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:06:59.400007 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.399940 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:06:59.400007 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.399954 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:06:59.409679 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.409632 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.429136 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.429108 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-107.ec2.internal\" not found" node="ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.431140 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.431120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.431224 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.431146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.431224 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.431183 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/148f933c9ee16c3446ec9479cab89d03-config\") pod \"kube-apiserver-proxy-ip-10-0-141-107.ec2.internal\" (UID: \"148f933c9ee16c3446ec9479cab89d03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.433355 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.433341 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-107.ec2.internal\" not found" node="ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.509733 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.509685 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.531978 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.531954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/148f933c9ee16c3446ec9479cab89d03-config\") pod \"kube-apiserver-proxy-ip-10-0-141-107.ec2.internal\" (UID: \"148f933c9ee16c3446ec9479cab89d03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.532059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.531932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/148f933c9ee16c3446ec9479cab89d03-config\") pod \"kube-apiserver-proxy-ip-10-0-141-107.ec2.internal\" (UID: \"148f933c9ee16c3446ec9479cab89d03\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.532059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.532043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.532130 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.532062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.532130 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.532070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.532130 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.532084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca8401d656e8c3bf2f8080975000534f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal\" (UID: \"ca8401d656e8c3bf2f8080975000534f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.610463 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.610439 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.711123 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.711074 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.732537 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.732522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.737063 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:06:59.737048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:06:59.811468 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.811439 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:06:59.911999 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:06:59.911972 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:07:00.012462 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:00.012409 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:07:00.112979 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:00.112955 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:07:00.175403 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.175381 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 17:07:00.175999 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.175541 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 17:07:00.213710 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:00.213689 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:07:00.223354 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:00.223321 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148f933c9ee16c3446ec9479cab89d03.slice/crio-9825eb106bc76cff7fe7115da171fbf8f654af78f5c61083a1757fee472a95a4 WatchSource:0}: Error finding container 9825eb106bc76cff7fe7115da171fbf8f654af78f5c61083a1757fee472a95a4: Status 404 returned error can't find the container with id 9825eb106bc76cff7fe7115da171fbf8f654af78f5c61083a1757fee472a95a4 Jun 10 17:07:00.224095 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:00.224079 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8401d656e8c3bf2f8080975000534f.slice/crio-349f8fde3b9cbb224da9e2f1b0f34dd004046c2b27b6953ca3ef53d98ca2ca1d WatchSource:0}: Error finding container 349f8fde3b9cbb224da9e2f1b0f34dd004046c2b27b6953ca3ef53d98ca2ca1d: Status 404 returned error can't find the container with id 349f8fde3b9cbb224da9e2f1b0f34dd004046c2b27b6953ca3ef53d98ca2ca1d Jun 10 17:07:00.227993 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.227975 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:07:00.241740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.241700 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 17:01:59 +0000 UTC" deadline="2028-02-03 15:08:09.692315735 +0000 UTC" Jun 10 17:07:00.241840 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.241742 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14470h1m9.450578346s" Jun 10 17:07:00.298869 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.298804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" event={"ID":"ca8401d656e8c3bf2f8080975000534f","Type":"ContainerStarted","Data":"349f8fde3b9cbb224da9e2f1b0f34dd004046c2b27b6953ca3ef53d98ca2ca1d"} Jun 10 17:07:00.299896 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.299878 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" event={"ID":"148f933c9ee16c3446ec9479cab89d03","Type":"ContainerStarted","Data":"9825eb106bc76cff7fe7115da171fbf8f654af78f5c61083a1757fee472a95a4"} Jun 10 17:07:00.314032 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:00.314016 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-107.ec2.internal\" not found" Jun 10 17:07:00.316697 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.316684 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:07:00.330055 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.330027 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" Jun 10 17:07:00.342372 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.342356 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 17:07:00.344196 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.344184 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" Jun 10 17:07:00.353832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.353816 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 17:07:00.375187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.375168 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:07:00.654489 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:00.654401 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:07:01.212776 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.212742 2559 apiserver.go:52] "Watching apiserver" Jun 10 17:07:01.224600 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.224565 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 17:07:01.225581 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.225552 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s5b62","kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-t9ngm","openshift-multus/network-metrics-daemon-lwb8p","openshift-network-diagnostics/network-check-target-dwsvb","openshift-network-operator/iptables-alerter-rpd67","openshift-ovn-kubernetes/ovnkube-node-cg7d4","kube-system/konnectivity-agent-22jfc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh","openshift-cluster-node-tuning-operator/tuned-r6wdf","openshift-dns/node-resolver-c2zvv","openshift-image-registry/node-ca-996t5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal","openshift-multus/multus-lwcqp"] Jun 10 17:07:01.227262 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.227239 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.228504 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.228481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.229901 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.229881 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 17:07:01.230319 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.230300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.230939 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.230911 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 17:07:01.230939 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.230924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.231066 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231009 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 17:07:01.231066 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 17:07:01.231963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231815 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.231963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231829 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wr2xb\"" Jun 10 17:07:01.231963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 17:07:01.231963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231917 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.231963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.231952 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.232242 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.232093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.232242 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.232147 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:01.232242 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.232181 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cg822\"" Jun 10 17:07:01.232637 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.232623 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.232966 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.232946 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:01.233039 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.233013 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:01.233174 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.233117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 17:07:01.233174 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.233160 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 17:07:01.233174 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.233165 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.233378 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.233360 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 17:07:01.233378 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.233372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rhkcg\"" Jun 10 17:07:01.234572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.234354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.237053 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.236689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.237450 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.237156 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhlxn\"" Jun 10 17:07:01.237450 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.237210 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.237450 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.237259 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.237450 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.237374 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 17:07:01.238157 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.238078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.239218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.239170 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.239376 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.239251 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gd7kh\"" Jun 10 17:07:01.239376 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.239344 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.239634 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.239616 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 17:07:01.239734 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.239724 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.240536 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-node-log\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-config\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-system-cni-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.240636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjk2\" (UniqueName: \"kubernetes.io/projected/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-kube-api-access-4xjk2\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.240636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-netd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nkws\" (UniqueName: \"kubernetes.io/projected/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-kube-api-access-5nkws\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cnibin\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240723 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lfnh\" (UniqueName: \"kubernetes.io/projected/bd80a0b4-d973-4825-a802-8a18a4e03d80-kube-api-access-6lfnh\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-systemd-units\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-slash\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.240853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-systemd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240892 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gr5hh\"" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.240892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-log-socket\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-bin\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-tmp-dir\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-hosts-file\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-script-lib\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-netns\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-var-lib-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-ovn\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovn-node-metrics-cert\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-kubelet\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-etc-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-env-overrides\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-os-release\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.241812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.241430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.242383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.242217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.242383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.242272 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 17:07:01.242383 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.242304 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:01.242383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.242322 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w8xnr\"" Jun 10 17:07:01.242383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.242272 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 17:07:01.243510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.243493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.244314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.244286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.244314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.244306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.244517 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.244286 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 17:07:01.244593 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.244547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lcjlm\"" Jun 10 17:07:01.245990 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.245971 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 17:07:01.247153 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.247133 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h2qs8\"" Jun 10 17:07:01.247663 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.247249 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 17:07:01.247663 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.247550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 17:07:01.268613 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.268590 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hw4zn" Jun 10 17:07:01.275309 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.275288 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hw4zn" Jun 10 17:07:01.291382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.291361 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:07:01.331666 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.331621 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 17:07:01.342014 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.341986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-hosts-file\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.342014 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdg2t\" (UniqueName: \"kubernetes.io/projected/e24ec875-6a09-4e4f-bdcc-84f181e46722-kube-api-access-qdg2t\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-run\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8br28\" (UniqueName: \"kubernetes.io/projected/fe7417c7-2c66-4f31-837a-4bd1bfede250-kube-api-access-8br28\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-hosts-file\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-k8s-cni-cncf-io\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-conf-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-netns\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-var-lib-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-tmp\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-socket-dir-parent\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcb8b\" (UniqueName: \"kubernetes.io/projected/747d025e-6dea-40bf-86cf-0fafb2932637-kube-api-access-fcb8b\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-var-lib-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-os-release\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342377 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-netns\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-os-release\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7417c7-2c66-4f31-837a-4bd1bfede250-serviceca\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-etc-kubernetes\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-node-log\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.342533 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-config\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-system-cni-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xjk2\" (UniqueName: \"kubernetes.io/projected/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-kube-api-access-4xjk2\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-system-cni-dir\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342593 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-node-log\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-bin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-multus-daemon-config\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-host\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342794 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-netd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-netd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nkws\" (UniqueName: \"kubernetes.io/projected/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-kube-api-access-5nkws\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-registration-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-lib-modules\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-cnibin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.342991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-os-release\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.343257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lfnh\" (UniqueName: \"kubernetes.io/projected/bd80a0b4-d973-4825-a802-8a18a4e03d80-kube-api-access-6lfnh\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-systemd-units\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-config\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-cni-binary-copy\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-multus\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4255a57d-f3f7-45ee-8c24-ad9e930e7935-agent-certs\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-dbus\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-systemd-units\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e24ec875-6a09-4e4f-bdcc-84f181e46722-iptables-alerter-script\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-conf\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-systemd\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7417c7-2c66-4f31-837a-4bd1bfede250-host\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-log-socket\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-tmp-dir\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.344034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-kubernetes\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-log-socket\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4255a57d-f3f7-45ee-8c24-ad9e930e7935-konnectivity-ca\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-socket-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpbk\" (UniqueName: \"kubernetes.io/projected/bb601533-2cf1-4822-85ea-a1b5f065bcae-kube-api-access-lkpbk\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-script-lib\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-ovn\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovn-node-metrics-cert\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzd5t\" (UniqueName: \"kubernetes.io/projected/bedac089-a4ed-4266-8b87-0534458b6e70-kube-api-access-fzd5t\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-kubelet-config\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-kubelet\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-etc-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-env-overrides\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-modprobe-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343766 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-tmp-dir\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-var-lib-kubelet\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjtt\" (UniqueName: \"kubernetes.io/projected/30c72e5d-deeb-4940-85a3-8b0deb9161e5-kube-api-access-gsjtt\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.344768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-hostroot\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-netns\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-multus-certs\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-etc-openvswitch\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cnibin\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-kubelet\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.343930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cnibin\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-ovn\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344093 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-system-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-slash\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-systemd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-sys-fs\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.345460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-kubelet\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-device-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-bin\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24ec875-6a09-4e4f-bdcc-84f181e46722-host-slash\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysconfig\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovnkube-script-lib\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-sys\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-etc-tuned\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bd80a0b4-d973-4825-a802-8a18a4e03d80-env-overrides\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-cni-bin\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-slash\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-run-systemd\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd80a0b4-d973-4825-a802-8a18a4e03d80-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.346168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.344912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.347709 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.347681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd80a0b4-d973-4825-a802-8a18a4e03d80-ovn-node-metrics-cert\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.353032 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.353010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nkws\" (UniqueName: \"kubernetes.io/projected/7c5ad405-69e9-4e4f-a8df-5b73e613aaa5-kube-api-access-5nkws\") pod \"node-resolver-c2zvv\" (UID: \"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5\") " pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.353185 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.353167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xjk2\" (UniqueName: \"kubernetes.io/projected/fe0ab740-3711-47b8-a5d5-c314b2f50bb7-kube-api-access-4xjk2\") pod \"multus-additional-cni-plugins-t9ngm\" (UID: \"fe0ab740-3711-47b8-a5d5-c314b2f50bb7\") " pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.353374 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.353358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lfnh\" (UniqueName: \"kubernetes.io/projected/bd80a0b4-d973-4825-a802-8a18a4e03d80-kube-api-access-6lfnh\") pod \"ovnkube-node-cg7d4\" (UID: \"bd80a0b4-d973-4825-a802-8a18a4e03d80\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.444876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.444842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4255a57d-f3f7-45ee-8c24-ad9e930e7935-agent-certs\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.444876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.444880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-dbus\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.445111 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.444900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e24ec875-6a09-4e4f-bdcc-84f181e46722-iptables-alerter-script\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.445111 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-conf\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445111 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-systemd\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445111 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445077 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-dbus\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7417c7-2c66-4f31-837a-4bd1bfede250-host\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-systemd\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-kubernetes\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4255a57d-f3f7-45ee-8c24-ad9e930e7935-konnectivity-ca\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe7417c7-2c66-4f31-837a-4bd1bfede250-host\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-socket-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-conf\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpbk\" (UniqueName: \"kubernetes.io/projected/bb601533-2cf1-4822-85ea-a1b5f065bcae-kube-api-access-lkpbk\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-kubernetes\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzd5t\" (UniqueName: \"kubernetes.io/projected/bedac089-a4ed-4266-8b87-0534458b6e70-kube-api-access-fzd5t\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-kubelet-config\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-modprobe-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-var-lib-kubelet\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-socket-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjtt\" (UniqueName: \"kubernetes.io/projected/30c72e5d-deeb-4940-85a3-8b0deb9161e5-kube-api-access-gsjtt\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-hostroot\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-netns\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-multus-certs\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e24ec875-6a09-4e4f-bdcc-84f181e46722-iptables-alerter-script\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-system-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-sys-fs\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-hostroot\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-kubelet\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-device-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.445794 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-modprobe-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-device-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4255a57d-f3f7-45ee-8c24-ad9e930e7935-konnectivity-ca\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24ec875-6a09-4e4f-bdcc-84f181e46722-host-slash\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-var-lib-kubelet\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysconfig\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-netns\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-sys\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-sys-fs\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-system-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-etc-tuned\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-multus-certs\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-kubelet\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysconfig\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdg2t\" (UniqueName: \"kubernetes.io/projected/e24ec875-6a09-4e4f-bdcc-84f181e46722-kube-api-access-qdg2t\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.446636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c808093-3f6d-43df-9b92-b1930c61e98b-kubelet-config\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.445924 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-run\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.445986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8br28\" (UniqueName: \"kubernetes.io/projected/fe7417c7-2c66-4f31-837a-4bd1bfede250-kube-api-access-8br28\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-k8s-cni-cncf-io\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-conf-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.446068 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:01.946035738 +0000 UTC m=+3.094582851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-run-k8s-cni-cncf-io\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-sys\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-tmp\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-socket-dir-parent\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-run\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-conf-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcb8b\" (UniqueName: \"kubernetes.io/projected/747d025e-6dea-40bf-86cf-0fafb2932637-kube-api-access-fcb8b\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-socket-dir-parent\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7417c7-2c66-4f31-837a-4bd1bfede250-serviceca\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24ec875-6a09-4e4f-bdcc-84f181e46722-host-slash\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.447420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-etc-kubernetes\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-etc-sysctl-d\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-etc-kubernetes\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-bin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-bin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.446476 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-multus-daemon-config\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-host\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-registration-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-lib-modules\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-cnibin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-os-release\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-registration-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-cni-binary-copy\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-multus\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-host\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.448039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe7417c7-2c66-4f31-837a-4bd1bfede250-serviceca\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-cnibin\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-os-release\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb601533-2cf1-4822-85ea-a1b5f065bcae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-host-var-lib-cni-multus\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.446972 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bedac089-a4ed-4266-8b87-0534458b6e70-lib-modules\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.447077 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:01.947061611 +0000 UTC m=+3.095608716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.447076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/747d025e-6dea-40bf-86cf-0fafb2932637-multus-cni-dir\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.447165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-cni-binary-copy\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.447601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/747d025e-6dea-40bf-86cf-0fafb2932637-multus-daemon-config\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.447909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4255a57d-f3f7-45ee-8c24-ad9e930e7935-agent-certs\") pod \"konnectivity-agent-22jfc\" (UID: \"4255a57d-f3f7-45ee-8c24-ad9e930e7935\") " pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.448725 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.448100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-etc-tuned\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.449154 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.449032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bedac089-a4ed-4266-8b87-0534458b6e70-tmp\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.470183 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.470115 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:01.470183 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.470148 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:01.470183 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.470162 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:01.470414 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.470267 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:01.970246287 +0000 UTC m=+3.118793393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:01.470719 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.470685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8br28\" (UniqueName: \"kubernetes.io/projected/fe7417c7-2c66-4f31-837a-4bd1bfede250-kube-api-access-8br28\") pod \"node-ca-996t5\" (UID: \"fe7417c7-2c66-4f31-837a-4bd1bfede250\") " pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.475979 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.475953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzd5t\" (UniqueName: \"kubernetes.io/projected/bedac089-a4ed-4266-8b87-0534458b6e70-kube-api-access-fzd5t\") pod \"tuned-r6wdf\" (UID: \"bedac089-a4ed-4266-8b87-0534458b6e70\") " pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.476841 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.476821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdg2t\" (UniqueName: \"kubernetes.io/projected/e24ec875-6a09-4e4f-bdcc-84f181e46722-kube-api-access-qdg2t\") pod \"iptables-alerter-rpd67\" (UID: \"e24ec875-6a09-4e4f-bdcc-84f181e46722\") " pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.478368 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.478344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcb8b\" (UniqueName: \"kubernetes.io/projected/747d025e-6dea-40bf-86cf-0fafb2932637-kube-api-access-fcb8b\") pod \"multus-lwcqp\" (UID: \"747d025e-6dea-40bf-86cf-0fafb2932637\") " pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.479756 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.479725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpbk\" (UniqueName: \"kubernetes.io/projected/bb601533-2cf1-4822-85ea-a1b5f065bcae-kube-api-access-lkpbk\") pod \"aws-ebs-csi-driver-node-ljkzh\" (UID: \"bb601533-2cf1-4822-85ea-a1b5f065bcae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.481956 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.481914 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjtt\" (UniqueName: \"kubernetes.io/projected/30c72e5d-deeb-4940-85a3-8b0deb9161e5-kube-api-access-gsjtt\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.539708 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.539677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:01.547534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.547510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2zvv" Jun 10 17:07:01.558166 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.558139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:01.562606 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.562584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" Jun 10 17:07:01.571142 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.571120 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpd67" Jun 10 17:07:01.578612 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.578590 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" Jun 10 17:07:01.584255 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.584233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lwcqp" Jun 10 17:07:01.591783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.591762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" Jun 10 17:07:01.596340 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.596318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-996t5" Jun 10 17:07:01.949693 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.949600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:01.949831 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.949761 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:01.949831 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:01.949804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:01.949831 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.949824 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:02.949805494 +0000 UTC m=+4.098352602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:01.949983 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.949873 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:01.949983 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:01.949907 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:02.9498971 +0000 UTC m=+4.098444203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:02.008687 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.008643 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd80a0b4_d973_4825_a802_8a18a4e03d80.slice/crio-3f7081b29054ae47384a81e8ee200ea5f58b779c1e3ed5d78fdf5af7794c12f8 WatchSource:0}: Error finding container 3f7081b29054ae47384a81e8ee200ea5f58b779c1e3ed5d78fdf5af7794c12f8: Status 404 returned error can't find the container with id 3f7081b29054ae47384a81e8ee200ea5f58b779c1e3ed5d78fdf5af7794c12f8 Jun 10 17:07:02.009798 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.009770 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747d025e_6dea_40bf_86cf_0fafb2932637.slice/crio-8a0dbd0b2d45ad7ee425f37fc3e6bbe03d4fc27939643d156105c271198ae0f2 WatchSource:0}: Error finding container 8a0dbd0b2d45ad7ee425f37fc3e6bbe03d4fc27939643d156105c271198ae0f2: Status 404 returned error can't find the container with id 8a0dbd0b2d45ad7ee425f37fc3e6bbe03d4fc27939643d156105c271198ae0f2 Jun 10 17:07:02.013473 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.013453 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7417c7_2c66_4f31_837a_4bd1bfede250.slice/crio-e5223c45ebd15aa8a267ee507193388aa3b62911a372df781a0fa72a7c27ab68 WatchSource:0}: Error finding container e5223c45ebd15aa8a267ee507193388aa3b62911a372df781a0fa72a7c27ab68: Status 404 returned error can't find the container with id e5223c45ebd15aa8a267ee507193388aa3b62911a372df781a0fa72a7c27ab68 Jun 10 17:07:02.014664 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.014627 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4255a57d_f3f7_45ee_8c24_ad9e930e7935.slice/crio-b62a38724900d495f112a178c289637404930fbe3e711aba67c8a768504a0242 WatchSource:0}: Error finding container b62a38724900d495f112a178c289637404930fbe3e711aba67c8a768504a0242: Status 404 returned error can't find the container with id b62a38724900d495f112a178c289637404930fbe3e711aba67c8a768504a0242 Jun 10 17:07:02.015445 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.015414 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0ab740_3711_47b8_a5d5_c314b2f50bb7.slice/crio-a94b4a6dc0592365f2fb63405ddfa5982b3d322d118add8ec63f6c183db94a0a WatchSource:0}: Error finding container a94b4a6dc0592365f2fb63405ddfa5982b3d322d118add8ec63f6c183db94a0a: Status 404 returned error can't find the container with id a94b4a6dc0592365f2fb63405ddfa5982b3d322d118add8ec63f6c183db94a0a Jun 10 17:07:02.017142 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.017124 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedac089_a4ed_4266_8b87_0534458b6e70.slice/crio-cf9cb7e04423c69b91714d91279cb5d9ccc1a14f80e99610b37882f7131961b9 WatchSource:0}: Error finding container cf9cb7e04423c69b91714d91279cb5d9ccc1a14f80e99610b37882f7131961b9: Status 404 returned error can't find the container with id cf9cb7e04423c69b91714d91279cb5d9ccc1a14f80e99610b37882f7131961b9 Jun 10 17:07:02.018451 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.018427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5ad405_69e9_4e4f_a8df_5b73e613aaa5.slice/crio-f454407e432ad907f26d0e49b7ce33704390798f611ef1bb37215ac36af5c2ad WatchSource:0}: Error finding container f454407e432ad907f26d0e49b7ce33704390798f611ef1bb37215ac36af5c2ad: Status 404 returned error can't find the container with id f454407e432ad907f26d0e49b7ce33704390798f611ef1bb37215ac36af5c2ad Jun 10 17:07:02.019441 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.019230 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ec875_6a09_4e4f_bdcc_84f181e46722.slice/crio-ec9d424252a27e2ac2184a40ef022b246bd4758d8ac6403540082cf34b55bfd3 WatchSource:0}: Error finding container ec9d424252a27e2ac2184a40ef022b246bd4758d8ac6403540082cf34b55bfd3: Status 404 returned error can't find the container with id ec9d424252a27e2ac2184a40ef022b246bd4758d8ac6403540082cf34b55bfd3 Jun 10 17:07:02.020826 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:02.020382 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb601533_2cf1_4822_85ea_a1b5f065bcae.slice/crio-e91bf993bd3f76cbe8e08b6d809d0d16c741e1e16e79cb8be8a00eb7597cd450 WatchSource:0}: Error finding container e91bf993bd3f76cbe8e08b6d809d0d16c741e1e16e79cb8be8a00eb7597cd450: Status 404 returned error can't find the container with id e91bf993bd3f76cbe8e08b6d809d0d16c741e1e16e79cb8be8a00eb7597cd450 Jun 10 17:07:02.051025 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.051002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:02.051184 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.051129 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:02.051184 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.051148 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:02.051184 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.051160 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:02.051326 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.051214 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:03.051197786 +0000 UTC m=+4.199744891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:02.277687 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.277497 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 17:02:01 +0000 UTC" deadline="2028-03-12 11:19:38.785745722 +0000 UTC" Jun 10 17:07:02.278016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.277688 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15378h12m36.508062974s" Jun 10 17:07:02.295829 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.295809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:02.295929 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.295902 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:02.304885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.304861 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca8401d656e8c3bf2f8080975000534f" containerID="66a26895c226f6f0f3e445743ab23954a8d2714d9d0d81d78f4020ef716977b9" exitCode=0 Jun 10 17:07:02.304974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.304920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" event={"ID":"ca8401d656e8c3bf2f8080975000534f","Type":"ContainerDied","Data":"66a26895c226f6f0f3e445743ab23954a8d2714d9d0d81d78f4020ef716977b9"} Jun 10 17:07:02.306459 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.306411 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" event={"ID":"148f933c9ee16c3446ec9479cab89d03","Type":"ContainerStarted","Data":"c94979926d0e4746d827559c68cc809cb4d6aec03d851c0690a5bfe22abe87b0"} Jun 10 17:07:02.307477 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.307460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpd67" event={"ID":"e24ec875-6a09-4e4f-bdcc-84f181e46722","Type":"ContainerStarted","Data":"ec9d424252a27e2ac2184a40ef022b246bd4758d8ac6403540082cf34b55bfd3"} Jun 10 17:07:02.308542 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.308515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" event={"ID":"bedac089-a4ed-4266-8b87-0534458b6e70","Type":"ContainerStarted","Data":"cf9cb7e04423c69b91714d91279cb5d9ccc1a14f80e99610b37882f7131961b9"} Jun 10 17:07:02.309752 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.309729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerStarted","Data":"a94b4a6dc0592365f2fb63405ddfa5982b3d322d118add8ec63f6c183db94a0a"} Jun 10 17:07:02.311635 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.311573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lwcqp" event={"ID":"747d025e-6dea-40bf-86cf-0fafb2932637","Type":"ContainerStarted","Data":"8a0dbd0b2d45ad7ee425f37fc3e6bbe03d4fc27939643d156105c271198ae0f2"} Jun 10 17:07:02.314061 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.314040 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" event={"ID":"bb601533-2cf1-4822-85ea-a1b5f065bcae","Type":"ContainerStarted","Data":"e91bf993bd3f76cbe8e08b6d809d0d16c741e1e16e79cb8be8a00eb7597cd450"} Jun 10 17:07:02.315101 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.315078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2zvv" event={"ID":"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5","Type":"ContainerStarted","Data":"f454407e432ad907f26d0e49b7ce33704390798f611ef1bb37215ac36af5c2ad"} Jun 10 17:07:02.316146 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.316125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22jfc" event={"ID":"4255a57d-f3f7-45ee-8c24-ad9e930e7935","Type":"ContainerStarted","Data":"b62a38724900d495f112a178c289637404930fbe3e711aba67c8a768504a0242"} Jun 10 17:07:02.317168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.317145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-996t5" event={"ID":"fe7417c7-2c66-4f31-837a-4bd1bfede250","Type":"ContainerStarted","Data":"e5223c45ebd15aa8a267ee507193388aa3b62911a372df781a0fa72a7c27ab68"} Jun 10 17:07:02.318224 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.318206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"3f7081b29054ae47384a81e8ee200ea5f58b779c1e3ed5d78fdf5af7794c12f8"} Jun 10 17:07:02.341928 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.341878 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-107.ec2.internal" podStartSLOduration=2.341860263 podStartE2EDuration="2.341860263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:02.341347795 +0000 UTC m=+3.489894929" watchObservedRunningTime="2026-06-10 17:07:02.341860263 +0000 UTC m=+3.490407380" Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.956438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:02.956498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.956631 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.956704 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:04.956684541 +0000 UTC m=+6.105231636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.957117 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:02.957197 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:02.957161 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:04.957147599 +0000 UTC m=+6.105694697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:03.057929 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.057351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:03.057929 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.057517 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:03.057929 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.057535 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:03.057929 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.057547 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:03.057929 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.057602 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:05.057583576 +0000 UTC m=+6.206130686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:03.278520 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.278390 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 17:02:01 +0000 UTC" deadline="2028-03-17 13:14:46.516044464 +0000 UTC" Jun 10 17:07:03.278520 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.278444 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15500h7m43.237604576s" Jun 10 17:07:03.296783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.296295 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:03.296783 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.296425 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:03.297563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.297083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:03.297563 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:03.297183 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:03.337531 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:03.337368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" event={"ID":"ca8401d656e8c3bf2f8080975000534f","Type":"ContainerStarted","Data":"14953f2c88353dde801185593c4ddc6cfdc122bf939f45f32a60210b94e2565d"} Jun 10 17:07:04.296849 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:04.296379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:04.296849 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:04.296505 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:04.974282 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:04.974248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:04.974442 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:04.974328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:04.974516 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:04.974455 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:04.974516 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:04.974515 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:08.97449638 +0000 UTC m=+10.123043476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:04.974913 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:04.974896 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:04.975014 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:04.974948 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:08.974934243 +0000 UTC m=+10.123481341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:05.074839 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:05.074802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:05.075070 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.075051 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:05.075158 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.075077 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:05.075158 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.075090 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:05.075158 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.075148 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:09.075131811 +0000 UTC m=+10.223678912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:05.296048 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:05.295972 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:05.296209 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.296121 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:05.296410 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:05.296392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:05.296516 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:05.296496 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:06.296330 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:06.296266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:06.296792 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:06.296395 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:07.296568 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:07.296525 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:07.297018 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:07.296698 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:07.297018 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:07.296716 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:07.297018 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:07.296836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:08.296707 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:08.296298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:08.296707 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:08.296427 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:09.007697 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:09.007661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:09.007887 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:09.007726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:09.007887 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.007832 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:09.007887 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.007845 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:09.008038 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.007916 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:17.007885295 +0000 UTC m=+18.156432408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:09.008038 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.007940 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:17.007929671 +0000 UTC m=+18.156476770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:09.108449 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:09.108414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:09.108766 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.108622 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:09.108766 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.108668 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:09.108766 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.108682 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:09.108766 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.108743 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:17.108725681 +0000 UTC m=+18.257272777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:09.296878 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:09.296805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:09.297287 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.296921 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:09.297371 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:09.297344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:09.297465 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:09.297443 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:10.296216 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:10.296103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:10.296400 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:10.296224 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:11.296903 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:11.296872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:11.297441 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:11.296872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:11.297441 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:11.297012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:11.297441 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:11.297068 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:12.296255 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:12.296179 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:12.296387 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:12.296304 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:13.296119 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:13.296089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:13.296119 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:13.296117 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:13.296599 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:13.296226 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:13.296599 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:13.296330 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:14.295768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:14.295736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:14.295952 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:14.295831 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:15.296413 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:15.296381 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:15.296881 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:15.296394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:15.296881 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:15.296504 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:15.296881 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:15.296583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:16.295900 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:16.295869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:16.296054 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:16.295988 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:17.066965 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:17.066926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:17.067348 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:17.066978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:17.067348 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.067078 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:17.067348 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.067148 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:07:33.067131725 +0000 UTC m=+34.215678834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:17.067348 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.067086 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:17.067348 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.067219 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:33.067206529 +0000 UTC m=+34.215753627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:17.167275 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:17.167241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:17.167461 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.167440 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:17.167524 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.167472 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:17.167524 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.167487 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:17.167615 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.167554 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:07:33.16753485 +0000 UTC m=+34.316081947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:17.299635 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:17.299606 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:17.299795 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:17.299638 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:17.299795 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.299713 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:17.299918 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:17.299867 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:18.296764 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:18.296734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:18.297213 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:18.296866 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:19.298595 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:19.298565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:19.299058 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:19.298686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:19.299058 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:19.298757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:19.299058 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:19.298849 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:20.296110 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:20.296073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:20.296276 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:20.296195 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:21.297063 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.296880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:21.297809 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.296938 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:21.297809 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:21.297146 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:21.297809 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:21.297213 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:21.373589 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.373501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" event={"ID":"bedac089-a4ed-4266-8b87-0534458b6e70","Type":"ContainerStarted","Data":"75cb65b05135c25b914844ea61477c2392826be425fccba5edba27390d0d0aca"} Jun 10 17:07:21.375363 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.375335 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="6e9123d60f0bae968b24d4bbeb56f869337c9d9a557b7a0f25b45d925cb8569d" exitCode=0 Jun 10 17:07:21.375495 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.375422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"6e9123d60f0bae968b24d4bbeb56f869337c9d9a557b7a0f25b45d925cb8569d"} Jun 10 17:07:21.377252 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.377225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lwcqp" event={"ID":"747d025e-6dea-40bf-86cf-0fafb2932637","Type":"ContainerStarted","Data":"cfa0b994d33b7e3f3b25a42a94e91620ecf77be53245834f3693fb72cf30fa45"} Jun 10 17:07:21.379018 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.378991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" event={"ID":"bb601533-2cf1-4822-85ea-a1b5f065bcae","Type":"ContainerStarted","Data":"838ff986ea9b3003d0c10e68bd905e6fab1b9d606d55c6b5f6bc79d90f9569c3"} Jun 10 17:07:21.380744 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.380713 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2zvv" event={"ID":"7c5ad405-69e9-4e4f-a8df-5b73e613aaa5","Type":"ContainerStarted","Data":"4be7295b2888a272f710221dc8f1e5e536ccd3fae8d7065f7e4334c417efa0d7"} Jun 10 17:07:21.382506 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.382474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22jfc" event={"ID":"4255a57d-f3f7-45ee-8c24-ad9e930e7935","Type":"ContainerStarted","Data":"9dad7788da3d5dd493b535d3f4b4d27b1a768e62064f4ed66a9234e236990ceb"} Jun 10 17:07:21.384101 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.384077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-996t5" event={"ID":"fe7417c7-2c66-4f31-837a-4bd1bfede250","Type":"ContainerStarted","Data":"392caec5e4af8ce60bb224244b61e857a0ecbb88af9f42e53543775736c6b36e"} Jun 10 17:07:21.387080 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:07:21.387377 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387356 2559 generic.go:356] "Generic (PLEG): container finished" podID="bd80a0b4-d973-4825-a802-8a18a4e03d80" containerID="d5741d229b82506ea37a593f375b641c1ff755d21216a58f2465bdaee7e655e8" exitCode=1 Jun 10 17:07:21.387458 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"2b5562a3f7f28bfed3db98f0f7eed9b894781246bee349b8f103afdb36fc653c"} Jun 10 17:07:21.387458 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"c350ac6f7f07ee7eeffea48c1a59c4741fba5437e4b702698a0d2aa1bee409ce"} Jun 10 17:07:21.387565 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387500 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"eb736989199a5fce6b1f1c10cdf8781dfa9ed4b4bd95f8bae63ed23ae461efe0"} Jun 10 17:07:21.387565 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"368d070dfc0a48d4d468155348f69c9404123d903452f87462f4ce1a98456163"} Jun 10 17:07:21.387686 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerDied","Data":"d5741d229b82506ea37a593f375b641c1ff755d21216a58f2465bdaee7e655e8"} Jun 10 17:07:21.387686 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.387645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"678b56c984e62f113be2d5a819782a1348b17a07e41ec86373c23a05932386af"} Jun 10 17:07:21.393665 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.393610 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6wdf" podStartSLOduration=4.007659683 podStartE2EDuration="22.393597758s" totalImagesPullingTime="18.385938075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:21.393300867 +0000 UTC m=+22.541847984" watchObservedRunningTime="2026-06-10 17:07:21.393597758 +0000 UTC m=+22.542144898" Jun 10 17:07:21.393837 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.393809 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-107.ec2.internal" podStartSLOduration=21.39379942 podStartE2EDuration="21.39379942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:03.354880474 +0000 UTC m=+4.503427590" watchObservedRunningTime="2026-06-10 17:07:21.39379942 +0000 UTC m=+22.542346537" Jun 10 17:07:21.441100 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.441046 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lwcqp" podStartSLOduration=4.00804032 podStartE2EDuration="22.441027695s" totalImagesPullingTime="18.432987375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:21.440623305 +0000 UTC m=+22.589170421" watchObservedRunningTime="2026-06-10 17:07:21.441027695 +0000 UTC m=+22.589574810" Jun 10 17:07:21.457628 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.457584 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c2zvv" podStartSLOduration=4.097288912 podStartE2EDuration="22.457570301s" totalImagesPullingTime="18.360281389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:21.457106799 +0000 UTC m=+22.605653916" watchObservedRunningTime="2026-06-10 17:07:21.457570301 +0000 UTC m=+22.606117417" Jun 10 17:07:21.491505 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.491459 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-22jfc" podStartSLOduration=4.193109454 podStartE2EDuration="22.491443821s" totalImagesPullingTime="18.298334367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:21.474842781 +0000 UTC m=+22.623389908" watchObservedRunningTime="2026-06-10 17:07:21.491443821 +0000 UTC m=+22.639990937" Jun 10 17:07:21.882680 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.882630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:21.954076 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:21.954056 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 17:07:22.020029 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.020001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:22.121440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.121411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:22.221666 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.221573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:22.295790 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.295766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:22.295970 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:22.295880 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:22.297894 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.297783 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T17:07:21.954071108Z","UUID":"2f00db75-dd78-45f6-beb4-8548f521716b","Handler":null,"Name":"","Endpoint":""} Jun 10 17:07:22.299424 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.299404 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 17:07:22.299524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.299445 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 17:07:22.324897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.324874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:22.392502 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.392466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpd67" event={"ID":"e24ec875-6a09-4e4f-bdcc-84f181e46722","Type":"ContainerStarted","Data":"84a2aa140e2f673eb85e85b81db4986cc568da341d4455e69a10a71e9ca5752d"} Jun 10 17:07:22.395211 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.395166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" event={"ID":"bb601533-2cf1-4822-85ea-a1b5f065bcae","Type":"ContainerStarted","Data":"bf96ef943ede2e9df0db6fadda194b42b479bdebdcd3254a5d58d11e23993255"} Jun 10 17:07:22.414393 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.414345 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-996t5" podStartSLOduration=5.049020023 podStartE2EDuration="23.414331427s" totalImagesPullingTime="18.365311404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:21.491066241 +0000 UTC m=+22.639613359" watchObservedRunningTime="2026-06-10 17:07:22.414331427 +0000 UTC m=+23.562878544" Jun 10 17:07:22.414784 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.414752 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rpd67" podStartSLOduration=5.031350888 podStartE2EDuration="23.414740903s" totalImagesPullingTime="18.383390015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:22.414473925 +0000 UTC m=+23.563021023" watchObservedRunningTime="2026-06-10 17:07:22.414740903 +0000 UTC m=+23.563288020" Jun 10 17:07:22.789035 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:22.788998 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:23.195522 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.195491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:23.296742 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.296709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:23.296867 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.296743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:23.296867 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:23.296819 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:23.296980 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:23.296947 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:23.400227 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.400195 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" event={"ID":"bb601533-2cf1-4822-85ea-a1b5f065bcae","Type":"ContainerStarted","Data":"52d939790af4dcf8bb6b8d58df9054c7d4d878f2ec4943db90f05974394362ea"} Jun 10 17:07:23.403523 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.403490 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:07:23.403978 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.403953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"6740408cc8051565e8216493e17cca77bfa4944883395ab59c89f547b2731280"} Jun 10 17:07:23.422886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.422838 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljkzh" podStartSLOduration=4.063261381 podStartE2EDuration="24.422819656s" totalImagesPullingTime="20.359558275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:23.422297782 +0000 UTC m=+24.570844898" watchObservedRunningTime="2026-06-10 17:07:23.422819656 +0000 UTC m=+24.571366773" Jun 10 17:07:23.523444 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.523372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:23.792330 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:23.792255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:24.093345 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.093091 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:24.093749 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.093722 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:24.185923 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.185885 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:24.296610 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.296581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:24.296776 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:24.296687 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:24.406567 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.406493 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:24.407011 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.406736 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-22jfc" Jun 10 17:07:24.606228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.606192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:24.983925 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:24.983888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:25.296355 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.296274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:25.296355 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.296312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:25.296582 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:25.296419 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:25.296582 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:25.296564 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:25.384770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.384743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:25.625976 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.625944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:25.727686 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.727485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:25.912952 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:25.912858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:26.013296 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.013259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:26.296178 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.296150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:26.296310 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:26.296240 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:26.394300 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.394272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:26.412324 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.412297 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="452b28238e24a4991f64385ea0b9d2828beb0f882b5c46d4d6338f0cf02dc845" exitCode=0 Jun 10 17:07:26.412440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.412384 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"452b28238e24a4991f64385ea0b9d2828beb0f882b5c46d4d6338f0cf02dc845"} Jun 10 17:07:26.415882 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.415868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:07:26.416235 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.416211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"724c690047c0050fea75af605bc9c9bfa88916cfc9941724a05065ca04c35628"} Jun 10 17:07:26.416377 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.416360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:26.416440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.416428 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:26.416590 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.416480 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:26.416685 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.416644 2559 scope.go:117] "RemoveContainer" containerID="d5741d229b82506ea37a593f375b641c1ff755d21216a58f2465bdaee7e655e8" Jun 10 17:07:26.433254 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.433237 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:26.433370 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.433358 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:26.458950 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.458918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:26.982658 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:26.982618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:27.296733 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.296643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:27.296733 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.296700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:27.296888 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:27.296789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:27.296923 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:27.296907 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:27.386924 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.386897 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:27.422049 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.422027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:07:27.422407 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.422384 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" event={"ID":"bd80a0b4-d973-4825-a802-8a18a4e03d80","Type":"ContainerStarted","Data":"fa0470077a8ceeaf118d471a5b6ead7341fff28875cc19aae12aa030a0d2e4c7"} Jun 10 17:07:27.424345 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.424320 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="ab4bed4dbf1fa1f20c6644183981245bdc6b2838f86eb38ce1305340a3a1bda7" exitCode=0 Jun 10 17:07:27.424422 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.424355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"ab4bed4dbf1fa1f20c6644183981245bdc6b2838f86eb38ce1305340a3a1bda7"} Jun 10 17:07:27.460537 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.460486 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" podStartSLOduration=10.029077568 podStartE2EDuration="28.460474201s" totalImagesPullingTime="18.431396633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:27.458785673 +0000 UTC m=+28.607332789" watchObservedRunningTime="2026-06-10 17:07:27.460474201 +0000 UTC m=+28.609021316" Jun 10 17:07:27.473800 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.473774 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:27.531769 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.531745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:27.591900 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.591838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:27.784390 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:27.784363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:28.202260 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:28.202234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:28.296390 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:28.296334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:28.296484 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:28.296421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:28.428941 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:28.428914 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="655113827d79fa8c1e4e5c73b430109346dd2ed9705df8b714314496a47ef8fd" exitCode=0 Jun 10 17:07:28.429078 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:28.428977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"655113827d79fa8c1e4e5c73b430109346dd2ed9705df8b714314496a47ef8fd"} Jun 10 17:07:28.970066 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:28.970038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:29.036711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.036676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:29.186676 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.186109 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:29.296979 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.296845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:29.296979 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:29.296967 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:29.297483 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.297014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:29.297483 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:29.297111 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:29.388024 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.387992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:29.584496 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.584412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:29.793572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:29.793541 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:30.296804 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:30.296779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:30.296951 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:30.296897 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:30.784972 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:30.784932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:30.985439 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:30.985407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:31.183453 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:31.183419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:31.295864 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:31.295836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:31.295864 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:31.295848 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:31.296046 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:31.295952 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:31.296097 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:31.296053 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:31.584126 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:31.584028 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:31.905716 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:31.905611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:32.007080 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.007036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:32.296062 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.296031 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:32.296222 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:32.296139 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:32.386427 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.386401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:32.588343 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.588319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:32.853049 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.852976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:32.951153 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:32.951122 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.017994 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.017961 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.090348 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.090319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:33.090478 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.090362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:33.090478 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.090455 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:33.090478 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.090455 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:33.090576 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.090501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs podName:30c72e5d-deeb-4940-85a3-8b0deb9161e5 nodeName:}" failed. No retries permitted until 2026-06-10 17:08:05.090488905 +0000 UTC m=+66.239035998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs") pod "network-metrics-daemon-lwb8p" (UID: "30c72e5d-deeb-4940-85a3-8b0deb9161e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:07:33.090576 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.090513 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret podName:7c808093-3f6d-43df-9b92-b1930c61e98b nodeName:}" failed. No retries permitted until 2026-06-10 17:08:05.090507785 +0000 UTC m=+66.239054880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret") pod "global-pull-secret-syncer-s5b62" (UID: "7c808093-3f6d-43df-9b92-b1930c61e98b") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:07:33.154821 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.154749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.190909 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.190879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:33.191042 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.191026 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:07:33.191081 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.191046 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:07:33.191081 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.191055 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jfvtg for pod openshift-network-diagnostics/network-check-target-dwsvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:33.191147 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.191104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg podName:9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e nodeName:}" failed. No retries permitted until 2026-06-10 17:08:05.191091813 +0000 UTC m=+66.339638907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfvtg" (UniqueName: "kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg") pod "network-check-target-dwsvb" (UID: "9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:07:33.295984 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.295949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:33.296191 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.296043 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:33.296191 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.296100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:33.296191 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:33.296181 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:33.330876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.330844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.431758 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.431719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.442773 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.442748 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="f6ca8175e5227a964d5f9dd24397bfce66fe3e37448597ed059d1513b1ce57cd" exitCode=0 Jun 10 17:07:33.442889 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.442810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"f6ca8175e5227a964d5f9dd24397bfce66fe3e37448597ed059d1513b1ce57cd"} Jun 10 17:07:33.754057 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.753987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.854714 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.854676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:33.969808 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:33.969775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:34.034943 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.034876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:34.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.296250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:34.296525 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:34.296342 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:34.447553 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.447517 2559 generic.go:356] "Generic (PLEG): container finished" podID="fe0ab740-3711-47b8-a5d5-c314b2f50bb7" containerID="bbbc3465b5b068349b2506190677f1a2cf0e1dc8f3e18f1628608076dd08c3e2" exitCode=0 Jun 10 17:07:34.447724 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.447564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerDied","Data":"bbbc3465b5b068349b2506190677f1a2cf0e1dc8f3e18f1628608076dd08c3e2"} Jun 10 17:07:34.538408 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.538381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:34.737041 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:34.737013 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:35.036937 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.036904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:35.296034 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.295952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:35.296177 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:35.296069 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:35.296177 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.296121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:35.296262 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:35.296217 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:35.453082 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.453048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" event={"ID":"fe0ab740-3711-47b8-a5d5-c314b2f50bb7","Type":"ContainerStarted","Data":"5dfea46e778787002a5d096109473dd01c87fb7b7f5d8e12dabc39e648c03d8a"} Jun 10 17:07:35.488128 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.488084 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9ngm" podStartSLOduration=9.037142236 podStartE2EDuration="36.488070692s" totalImagesPullingTime="27.450928456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:35.487952983 +0000 UTC m=+36.636500099" watchObservedRunningTime="2026-06-10 17:07:35.488070692 +0000 UTC m=+36.636617805" Jun 10 17:07:35.751542 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.751510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:35.806229 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:35.806200 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:36.296275 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:36.296244 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:36.296641 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:36.296347 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:37.295986 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:37.295958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:37.296142 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:37.296064 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:37.296190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:37.296139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:37.296248 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:37.296230 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:38.295851 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:38.295824 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:38.296222 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:38.295919 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:39.296743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:39.296712 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:39.297147 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:39.296836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:39.297147 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:39.296898 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:39.297147 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:39.296987 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:40.092474 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.092283 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:40.202909 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.202879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:40.295982 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.295945 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:40.296162 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:40.296049 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:40.372440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.372367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:40.471476 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.471441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:40.576204 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:40.576174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:41.296764 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.296740 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:41.296903 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.296739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:41.296903 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:41.296884 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:41.297038 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:41.296956 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:41.516346 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.516312 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwb8p"] Jun 10 17:07:41.516905 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.516432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:41.516905 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:41.516557 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:41.522323 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.522282 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5b62"] Jun 10 17:07:41.522789 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.522754 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:41.522913 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:41.522888 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:41.529239 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.529216 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dwsvb"] Jun 10 17:07:41.529336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:41.529303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:41.529398 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:41.529375 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:43.295791 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:43.295757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:43.296299 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:43.295759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:43.296299 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:43.295875 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5b62" podUID="7c808093-3f6d-43df-9b92-b1930c61e98b" Jun 10 17:07:43.296299 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:43.295761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:43.296299 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:43.295948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwb8p" podUID="30c72e5d-deeb-4940-85a3-8b0deb9161e5" Jun 10 17:07:43.296299 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:43.296030 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwsvb" podUID="9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e" Jun 10 17:07:43.973614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:43.973584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.077984 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.077957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.172294 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.172268 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.352239 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.352161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.424724 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.424697 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.498120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.498094 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.595560 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.595536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:44.652757 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:44.652682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:45.101576 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.101552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:45.168322 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.168294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:45.193201 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.193178 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-107.ec2.internal" event="NodeReady" Jun 10 17:07:45.193299 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.193275 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 17:07:45.234775 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.234746 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b5d84cd5c-8wzpj"] Jun 10 17:07:45.246631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.246609 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbn2q"] Jun 10 17:07:45.246743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.246727 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.249256 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.249235 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 17:07:45.249351 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.249291 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 17:07:45.249568 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.249552 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 17:07:45.249624 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.249560 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2qjb8\"" Jun 10 17:07:45.261392 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.261373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5d84cd5c-8wzpj"] Jun 10 17:07:45.261392 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.261401 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4gltv"] Jun 10 17:07:45.261529 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.261510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.262737 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.262719 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 17:07:45.264102 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.264084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 17:07:45.264304 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.264286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 17:07:45.264429 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.264407 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 17:07:45.264526 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.264507 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 17:07:45.264742 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.264728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65458\"" Jun 10 17:07:45.275217 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.275199 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbn2q"] Jun 10 17:07:45.275301 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.275231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4gltv"] Jun 10 17:07:45.275301 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.275298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.278169 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.278150 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 17:07:45.278266 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.278151 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rk7vt\"" Jun 10 17:07:45.278266 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.278160 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 17:07:45.278266 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.278202 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 17:07:45.282611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.282716 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-certificates\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.282716 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750ef407-6256-44ee-b7d4-ac5d2e396971-data-volume\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.282833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-installation-pull-secrets\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.282833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-tls\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.282833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wqs9\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-kube-api-access-4wqs9\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.282833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-trusted-ca\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-bound-sa-token\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e59bbf-2444-4634-aae2-58edd6694123-cert\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndmzc\" (UniqueName: \"kubernetes.io/projected/28e59bbf-2444-4634-aae2-58edd6694123-kube-api-access-ndmzc\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750ef407-6256-44ee-b7d4-ac5d2e396971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.282984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750ef407-6256-44ee-b7d4-ac5d2e396971-crio-socket\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.283031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.283014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-image-registry-private-configuration\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.283247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.283052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6jx7\" (UniqueName: \"kubernetes.io/projected/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-api-access-v6jx7\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.283247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.283075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5714815-3f22-439d-a08f-2c7846e53d8a-ca-trust-extracted\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.296787 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.296769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:07:45.296878 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.296769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:07:45.296961 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.296779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:07:45.299553 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299537 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 17:07:45.299834 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299820 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 17:07:45.299919 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m7vsv\"" Jun 10 17:07:45.299919 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwf4k\"" Jun 10 17:07:45.300050 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299974 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 17:07:45.300050 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.299980 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 17:07:45.355806 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.355780 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2vb57"] Jun 10 17:07:45.362928 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.362908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.365539 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.365518 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6hdxh\"" Jun 10 17:07:45.365699 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.365684 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 17:07:45.365966 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.365952 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 17:07:45.368874 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.368847 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2vb57"] Jun 10 17:07:45.383337 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe23b43-6677-45fd-a4ee-faef86643502-metrics-tls\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.383435 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h68k\" (UniqueName: \"kubernetes.io/projected/ffe23b43-6677-45fd-a4ee-faef86643502-kube-api-access-2h68k\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.383435 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23b43-6677-45fd-a4ee-faef86643502-config-volume\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.383435 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.383435 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-certificates\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750ef407-6256-44ee-b7d4-ac5d2e396971-data-volume\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.383640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-installation-pull-secrets\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-tls\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wqs9\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-kube-api-access-4wqs9\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-trusted-ca\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-bound-sa-token\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e59bbf-2444-4634-aae2-58edd6694123-cert\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndmzc\" (UniqueName: \"kubernetes.io/projected/28e59bbf-2444-4634-aae2-58edd6694123-kube-api-access-ndmzc\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750ef407-6256-44ee-b7d4-ac5d2e396971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe23b43-6677-45fd-a4ee-faef86643502-tmp-dir\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.383857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750ef407-6256-44ee-b7d4-ac5d2e396971-data-volume\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750ef407-6256-44ee-b7d4-ac5d2e396971-crio-socket\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383889 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-image-registry-private-configuration\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6jx7\" (UniqueName: \"kubernetes.io/projected/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-api-access-v6jx7\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5714815-3f22-439d-a08f-2c7846e53d8a-ca-trust-extracted\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.383995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.384190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.384149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-certificates\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.384467 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.384213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750ef407-6256-44ee-b7d4-ac5d2e396971-crio-socket\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.384467 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.384299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5714815-3f22-439d-a08f-2c7846e53d8a-ca-trust-extracted\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.384745 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.384722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5714815-3f22-439d-a08f-2c7846e53d8a-trusted-ca\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.387645 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.387624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-image-registry-private-configuration\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.387798 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.387778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750ef407-6256-44ee-b7d4-ac5d2e396971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.387840 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.387826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5714815-3f22-439d-a08f-2c7846e53d8a-installation-pull-secrets\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.387890 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.387869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-registry-tls\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.387925 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.387878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e59bbf-2444-4634-aae2-58edd6694123-cert\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.393572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.393513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6jx7\" (UniqueName: \"kubernetes.io/projected/750ef407-6256-44ee-b7d4-ac5d2e396971-kube-api-access-v6jx7\") pod \"insights-runtime-extractor-vbn2q\" (UID: \"750ef407-6256-44ee-b7d4-ac5d2e396971\") " pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.393717 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.393695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndmzc\" (UniqueName: \"kubernetes.io/projected/28e59bbf-2444-4634-aae2-58edd6694123-kube-api-access-ndmzc\") pod \"ingress-canary-4gltv\" (UID: \"28e59bbf-2444-4634-aae2-58edd6694123\") " pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.394108 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.394081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-bound-sa-token\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.394206 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.394126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wqs9\" (UniqueName: \"kubernetes.io/projected/e5714815-3f22-439d-a08f-2c7846e53d8a-kube-api-access-4wqs9\") pod \"image-registry-5b5d84cd5c-8wzpj\" (UID: \"e5714815-3f22-439d-a08f-2c7846e53d8a\") " pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.464087 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.464065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:45.484494 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.484474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe23b43-6677-45fd-a4ee-faef86643502-metrics-tls\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.484605 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.484499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h68k\" (UniqueName: \"kubernetes.io/projected/ffe23b43-6677-45fd-a4ee-faef86643502-kube-api-access-2h68k\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.484605 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.484522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23b43-6677-45fd-a4ee-faef86643502-config-volume\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.484605 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.484569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe23b43-6677-45fd-a4ee-faef86643502-tmp-dir\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.484848 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.484833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe23b43-6677-45fd-a4ee-faef86643502-tmp-dir\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.485136 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.485116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe23b43-6677-45fd-a4ee-faef86643502-config-volume\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.486623 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.486603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe23b43-6677-45fd-a4ee-faef86643502-metrics-tls\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.493665 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.493630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h68k\" (UniqueName: \"kubernetes.io/projected/ffe23b43-6677-45fd-a4ee-faef86643502-kube-api-access-2h68k\") pod \"dns-default-2vb57\" (UID: \"ffe23b43-6677-45fd-a4ee-faef86643502\") " pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.559214 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.559151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:45.570279 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.570254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbn2q" Jun 10 17:07:45.583430 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.583395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4gltv" Jun 10 17:07:45.671557 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.671351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:45.754121 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.754094 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:45.794019 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.793986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5d84cd5c-8wzpj"] Jun 10 17:07:45.796720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.796620 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbn2q"] Jun 10 17:07:45.797472 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.797341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4gltv"] Jun 10 17:07:45.797837 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:45.797810 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5714815_3f22_439d_a08f_2c7846e53d8a.slice/crio-548aecc0cd22d621e36e089acdacb1572da348d849b2aba0c1a034a2797ccd38 WatchSource:0}: Error finding container 548aecc0cd22d621e36e089acdacb1572da348d849b2aba0c1a034a2797ccd38: Status 404 returned error can't find the container with id 548aecc0cd22d621e36e089acdacb1572da348d849b2aba0c1a034a2797ccd38 Jun 10 17:07:45.799665 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:45.799507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750ef407_6256_44ee_b7d4_ac5d2e396971.slice/crio-ebb3c0b1e8e9f3169f1e63181c8b02fd932fa368d8bf9a4d48b51bad4e072823 WatchSource:0}: Error finding container ebb3c0b1e8e9f3169f1e63181c8b02fd932fa368d8bf9a4d48b51bad4e072823: Status 404 returned error can't find the container with id ebb3c0b1e8e9f3169f1e63181c8b02fd932fa368d8bf9a4d48b51bad4e072823 Jun 10 17:07:45.800348 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:45.800320 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e59bbf_2444_4634_aae2_58edd6694123.slice/crio-44f649b93e2cbe6848f31936624e612447ed1f011485499e78270ba61c4b6bc5 WatchSource:0}: Error finding container 44f649b93e2cbe6848f31936624e612447ed1f011485499e78270ba61c4b6bc5: Status 404 returned error can't find the container with id 44f649b93e2cbe6848f31936624e612447ed1f011485499e78270ba61c4b6bc5 Jun 10 17:07:45.840144 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.840102 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2vb57"] Jun 10 17:07:45.844717 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:45.844692 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe23b43_6677_45fd_a4ee_faef86643502.slice/crio-12a3aeff37c2c275fd975d2a26d0a5fe2bf0922f14477f2eefc075be4d580a66 WatchSource:0}: Error finding container 12a3aeff37c2c275fd975d2a26d0a5fe2bf0922f14477f2eefc075be4d580a66: Status 404 returned error can't find the container with id 12a3aeff37c2c275fd975d2a26d0a5fe2bf0922f14477f2eefc075be4d580a66 Jun 10 17:07:45.849077 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:45.849047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:46.250259 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.250218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:46.314827 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.314798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:46.479735 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.479694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2vb57" event={"ID":"ffe23b43-6677-45fd-a4ee-faef86643502","Type":"ContainerStarted","Data":"12a3aeff37c2c275fd975d2a26d0a5fe2bf0922f14477f2eefc075be4d580a66"} Jun 10 17:07:46.481363 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.481334 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" event={"ID":"e5714815-3f22-439d-a08f-2c7846e53d8a","Type":"ContainerStarted","Data":"4145690bd4c391cfbfd571af82051405076efbcf4299ff80157a70c42df358ca"} Jun 10 17:07:46.481535 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.481390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" event={"ID":"e5714815-3f22-439d-a08f-2c7846e53d8a","Type":"ContainerStarted","Data":"548aecc0cd22d621e36e089acdacb1572da348d849b2aba0c1a034a2797ccd38"} Jun 10 17:07:46.481535 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.481470 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:07:46.482707 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.482675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4gltv" event={"ID":"28e59bbf-2444-4634-aae2-58edd6694123","Type":"ContainerStarted","Data":"44f649b93e2cbe6848f31936624e612447ed1f011485499e78270ba61c4b6bc5"} Jun 10 17:07:46.484305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.484274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbn2q" event={"ID":"750ef407-6256-44ee-b7d4-ac5d2e396971","Type":"ContainerStarted","Data":"54dafc67cf8d31eb4fc469f846bc1906475366018743298ffcc7ce832f59621e"} Jun 10 17:07:46.484391 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.484326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbn2q" event={"ID":"750ef407-6256-44ee-b7d4-ac5d2e396971","Type":"ContainerStarted","Data":"ebb3c0b1e8e9f3169f1e63181c8b02fd932fa368d8bf9a4d48b51bad4e072823"} Jun 10 17:07:46.506860 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:46.506702 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" podStartSLOduration=6.506678744 podStartE2EDuration="6.506678744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:46.504563694 +0000 UTC m=+47.653110839" watchObservedRunningTime="2026-06-10 17:07:46.506678744 +0000 UTC m=+47.655225864" Jun 10 17:07:47.786216 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:47.786031 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:47.850715 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:47.850623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:47.952843 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:47.952812 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:48.057300 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:48.057269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:48.126151 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:48.126071 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:48.192177 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:48.192141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:48.492380 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:48.492346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbn2q" event={"ID":"750ef407-6256-44ee-b7d4-ac5d2e396971","Type":"ContainerStarted","Data":"bf8754d2c7e8270b20d4f4143c21dd20a246caaa0bc1d94fb4c2d461af2fee7d"} Jun 10 17:07:48.493780 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:48.493757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2vb57" event={"ID":"ffe23b43-6677-45fd-a4ee-faef86643502","Type":"ContainerStarted","Data":"eddc7163c9919ca0aef3fc516b018e258a6b21d6240dc37b94064dabe3fa2a3e"} Jun 10 17:07:49.436068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.436008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:49.499785 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.499743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4gltv" event={"ID":"28e59bbf-2444-4634-aae2-58edd6694123","Type":"ContainerStarted","Data":"52648cf5e19ff74bfd3f754083accc647e602d5e27829bd7340e1cb48946a0c1"} Jun 10 17:07:49.501611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.501581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2vb57" event={"ID":"ffe23b43-6677-45fd-a4ee-faef86643502","Type":"ContainerStarted","Data":"ffda516fa2235b2cd1bd719926e312a4a23c4552d55b7eee21e1dc93eb0d4e56"} Jun 10 17:07:49.501732 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.501721 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:49.518352 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.518303 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4gltv" podStartSLOduration=1.375824974 podStartE2EDuration="4.518285153s" totalImagesPullingTime="3.142460179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:49.517606314 +0000 UTC m=+50.666153432" watchObservedRunningTime="2026-06-10 17:07:49.518285153 +0000 UTC m=+50.666832270" Jun 10 17:07:49.523123 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.523103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:49.538060 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.538011 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2vb57" podStartSLOduration=2.512281282 podStartE2EDuration="4.537994584s" totalImagesPullingTime="2.025713302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:49.537677917 +0000 UTC m=+50.686225032" watchObservedRunningTime="2026-06-10 17:07:49.537994584 +0000 UTC m=+50.686541701" Jun 10 17:07:49.584029 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.584002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:49.684867 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:49.684838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:50.388121 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.387923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:50.447842 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.447768 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:50.507686 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.507626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbn2q" event={"ID":"750ef407-6256-44ee-b7d4-ac5d2e396971","Type":"ContainerStarted","Data":"a94ad042fe6fb3d8d435bbfde89fa022fbcd6fd91b79aa77cdac467b445e164b"} Jun 10 17:07:50.530969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.530923 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbn2q" podStartSLOduration=1.436078242 podStartE2EDuration="5.530908613s" totalImagesPullingTime="4.094830371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:07:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:50.530524182 +0000 UTC m=+51.679071298" watchObservedRunningTime="2026-06-10 17:07:50.530908613 +0000 UTC m=+51.679455729" Jun 10 17:07:50.774192 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.774112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:50.835904 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:50.835870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:51.174623 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:51.174592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:51.238620 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:51.238592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:51.977881 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:51.977853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:52.039060 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:52.039030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:54.320369 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.320342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:54.422521 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.422491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:54.451492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.451460 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg"] Jun 10 17:07:54.454048 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.454033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.456976 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.456957 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 17:07:54.458575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.458554 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 17:07:54.458575 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.458564 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 17:07:54.458738 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.458599 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 17:07:54.458738 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.458563 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 17:07:54.458916 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.458903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bwm4q\"" Jun 10 17:07:54.466675 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.466639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg"] Jun 10 17:07:54.489247 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.489215 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:54.556342 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.556309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6jq\" (UniqueName: \"kubernetes.io/projected/52993eed-307c-4de8-8e92-0b5da6ac62a5-kube-api-access-pb6jq\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.556342 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.556354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52993eed-307c-4de8-8e92-0b5da6ac62a5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.556567 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.556455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.556567 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.556485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.638551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.638457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:54.656917 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.656881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6jq\" (UniqueName: \"kubernetes.io/projected/52993eed-307c-4de8-8e92-0b5da6ac62a5-kube-api-access-pb6jq\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.656917 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.656922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52993eed-307c-4de8-8e92-0b5da6ac62a5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.657149 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.656971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.657149 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.657126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.657793 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.657771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52993eed-307c-4de8-8e92-0b5da6ac62a5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.660986 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.660962 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.661086 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.660973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/52993eed-307c-4de8-8e92-0b5da6ac62a5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.666778 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.666755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6jq\" (UniqueName: \"kubernetes.io/projected/52993eed-307c-4de8-8e92-0b5da6ac62a5-kube-api-access-pb6jq\") pod \"prometheus-operator-7f7d445d84-lkvlg\" (UID: \"52993eed-307c-4de8-8e92-0b5da6ac62a5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.763045 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.763019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" Jun 10 17:07:54.888486 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:54.888450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg"] Jun 10 17:07:54.892183 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:54.892152 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52993eed_307c_4de8_8e92_0b5da6ac62a5.slice/crio-e00239d4aa59872896fe929c07eed3365a782879f1b8cc7a47dde01d06160164 WatchSource:0}: Error finding container e00239d4aa59872896fe929c07eed3365a782879f1b8cc7a47dde01d06160164: Status 404 returned error can't find the container with id e00239d4aa59872896fe929c07eed3365a782879f1b8cc7a47dde01d06160164 Jun 10 17:07:55.523379 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:55.523335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" event={"ID":"52993eed-307c-4de8-8e92-0b5da6ac62a5","Type":"ContainerStarted","Data":"e00239d4aa59872896fe929c07eed3365a782879f1b8cc7a47dde01d06160164"} Jun 10 17:07:56.175693 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:56.175663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:56.528328 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:56.528245 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" event={"ID":"52993eed-307c-4de8-8e92-0b5da6ac62a5","Type":"ContainerStarted","Data":"21e5c012bc052321d9e2ef2eabff2797341d5593456ffcde6547fa9ac30eb2ae"} Jun 10 17:07:56.528328 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:56.528294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" event={"ID":"52993eed-307c-4de8-8e92-0b5da6ac62a5","Type":"ContainerStarted","Data":"080d9d3e49ba52a3f160982febb826bc6ad74e024ce6623e3f939ad41907d48e"} Jun 10 17:07:56.549175 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:56.549126 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-lkvlg" podStartSLOduration=1.5308530949999999 podStartE2EDuration="2.549111363s" totalImagesPullingTime="1.018258268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:07:56.547834359 +0000 UTC m=+57.696381475" watchObservedRunningTime="2026-06-10 17:07:56.549111363 +0000 UTC m=+57.697658478" Jun 10 17:07:58.439572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.439537 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg7d4" Jun 10 17:07:58.561876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.561841 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:58.661898 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.661866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:58.762130 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.762050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:58.867046 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.867014 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc"] Jun 10 17:07:58.869940 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.869918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.870398 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.870377 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vbxmr"] Jun 10 17:07:58.873120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.871409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:58.873120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.872905 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 17:07:58.873120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.873067 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jsrrs\"" Jun 10 17:07:58.873351 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.873148 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.874579 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.874552 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 17:07:58.874924 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.874903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 17:07:58.876331 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.876311 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k6wh8\"" Jun 10 17:07:58.876407 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.876317 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 17:07:58.876407 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.876372 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 17:07:58.876407 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.876374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 17:07:58.883781 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.883757 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc"] Jun 10 17:07:58.970548 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.970519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:58.990617 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-root\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.990617 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-wtmp\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.990815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w746p\" (UniqueName: \"kubernetes.io/projected/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-api-access-w746p\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-accelerators-collector-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.990815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-sys\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.990815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e01c5b7-bf07-4e74-9619-b9460469f402-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:58.990969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfx7\" (UniqueName: \"kubernetes.io/projected/1775aeee-3738-4f90-869d-70ab84ae8023-kube-api-access-9cfx7\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.991088 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-textfile\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.991088 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.990999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-metrics-client-ca\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.991088 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.991020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-tls\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:58.991088 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:58.991045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.070511 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.070427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.091589 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.091689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w746p\" (UniqueName: \"kubernetes.io/projected/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-api-access-w746p\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.091689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-accelerators-collector-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.091882 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-sys\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092005 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092005 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091924 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-sys\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092005 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e01c5b7-bf07-4e74-9619-b9460469f402-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092005 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.091989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfx7\" (UniqueName: \"kubernetes.io/projected/1775aeee-3738-4f90-869d-70ab84ae8023-kube-api-access-9cfx7\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-textfile\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-metrics-client-ca\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-tls\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:59.092188 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 17:07:59.092220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:07:59.092249 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls podName:0e01c5b7-bf07-4e74-9619-b9460469f402 nodeName:}" failed. No retries permitted until 2026-06-10 17:07:59.592230765 +0000 UTC m=+60.740777860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-rrvsc" (UID: "0e01c5b7-bf07-4e74-9619-b9460469f402") : secret "kube-state-metrics-tls" not found Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e01c5b7-bf07-4e74-9619-b9460469f402-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-accelerators-collector-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-root\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-wtmp\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-root\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-wtmp\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.092906 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.092906 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.092768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-textfile\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.093110 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.093089 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1775aeee-3738-4f90-869d-70ab84ae8023-metrics-client-ca\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.093110 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.093103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e01c5b7-bf07-4e74-9619-b9460469f402-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.094333 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.094307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.094423 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.094392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.094569 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.094553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1775aeee-3738-4f90-869d-70ab84ae8023-node-exporter-tls\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.103668 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.103637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w746p\" (UniqueName: \"kubernetes.io/projected/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-api-access-w746p\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.103759 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.103677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfx7\" (UniqueName: \"kubernetes.io/projected/1775aeee-3738-4f90-869d-70ab84ae8023-kube-api-access-9cfx7\") pod \"node-exporter-vbxmr\" (UID: \"1775aeee-3738-4f90-869d-70ab84ae8023\") " pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.189744 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.189709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vbxmr" Jun 10 17:07:59.191638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.191612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.199251 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:07:59.199224 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1775aeee_3738_4f90_869d_70ab84ae8023.slice/crio-da43435e16dfbd2ae4f1cf4fbcee049d0d4f75392ad441cc913041365815b232 WatchSource:0}: Error finding container da43435e16dfbd2ae4f1cf4fbcee049d0d4f75392ad441cc913041365815b232: Status 404 returned error can't find the container with id da43435e16dfbd2ae4f1cf4fbcee049d0d4f75392ad441cc913041365815b232 Jun 10 17:07:59.292504 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.292476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.393168 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.393070 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.510024 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.509997 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2vb57" Jun 10 17:07:59.538695 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.538664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vbxmr" event={"ID":"1775aeee-3738-4f90-869d-70ab84ae8023","Type":"ContainerStarted","Data":"da43435e16dfbd2ae4f1cf4fbcee049d0d4f75392ad441cc913041365815b232"} Jun 10 17:07:59.585352 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.585321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.596422 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.596390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.598683 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.598638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e01c5b7-bf07-4e74-9619-b9460469f402-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rrvsc\" (UID: \"0e01c5b7-bf07-4e74-9619-b9460469f402\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.686677 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.686633 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.786666 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.786624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jsrrs\"" Jun 10 17:07:59.794219 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.794193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" Jun 10 17:07:59.813096 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.813061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.906577 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.906472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:07:59.926035 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.926005 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:07:59.929768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.929242 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933593 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933556 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933689 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933556 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 17:07:59.933838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.933823 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 17:07:59.935059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.934049 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kzgjb\"" Jun 10 17:07:59.935059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.934253 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 17:07:59.935059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.934467 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 17:07:59.946514 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.946492 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc"] Jun 10 17:07:59.950160 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:07:59.950067 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:08:00.000269 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000269 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dgqj\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.000876 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.000582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.075796 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:08:00.075760 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e01c5b7_bf07_4e74_9619_b9460469f402.slice/crio-a8bce8511b43accaabbb4b3654d59f8b4052f9872ffbff2db54b7700fb31b0cf WatchSource:0}: Error finding container a8bce8511b43accaabbb4b3654d59f8b4052f9872ffbff2db54b7700fb31b0cf: Status 404 returned error can't find the container with id a8bce8511b43accaabbb4b3654d59f8b4052f9872ffbff2db54b7700fb31b0cf Jun 10 17:08:00.101366 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dgqj\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.101854 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.101789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.103388 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.102493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.103388 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.102638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.103388 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:08:00.102768 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 17:08:00.103388 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:08:00.102829 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls podName:f892ddf6-e44d-4a5d-ae6e-c0f679643cf1 nodeName:}" failed. No retries permitted until 2026-06-10 17:08:00.602808907 +0000 UTC m=+61.751356019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1") : secret "alertmanager-main-tls" not found Jun 10 17:08:00.104333 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.104266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.105334 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.105282 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.106007 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.105962 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.106167 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.106145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.106236 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.106212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.106236 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.106224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.106982 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.106960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.107419 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.107396 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.107770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.107754 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.113215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.113192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dgqj\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.140499 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.140461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:00.241518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.241464 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:00.341675 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.341617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:00.543501 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.543419 2559 generic.go:356] "Generic (PLEG): container finished" podID="1775aeee-3738-4f90-869d-70ab84ae8023" containerID="70de6df7ef9f71470f6bf688df8b162c3e746633fea5c07593a6aa0881567b39" exitCode=0 Jun 10 17:08:00.543931 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.543512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vbxmr" event={"ID":"1775aeee-3738-4f90-869d-70ab84ae8023","Type":"ContainerDied","Data":"70de6df7ef9f71470f6bf688df8b162c3e746633fea5c07593a6aa0881567b39"} Jun 10 17:08:00.544604 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.544585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" event={"ID":"0e01c5b7-bf07-4e74-9619-b9460469f402","Type":"ContainerStarted","Data":"a8bce8511b43accaabbb4b3654d59f8b4052f9872ffbff2db54b7700fb31b0cf"} Jun 10 17:08:00.606128 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.606101 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.608609 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.608581 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.841400 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.841314 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:08:00.982508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:00.980673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:08:00.985491 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:08:00.985456 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf892ddf6_e44d_4a5d_ae6e_c0f679643cf1.slice/crio-0e0190c378d4f17956cf7e249c4c29415ee33bbc82a8af58cf92fdb7213b1053 WatchSource:0}: Error finding container 0e0190c378d4f17956cf7e249c4c29415ee33bbc82a8af58cf92fdb7213b1053: Status 404 returned error can't find the container with id 0e0190c378d4f17956cf7e249c4c29415ee33bbc82a8af58cf92fdb7213b1053 Jun 10 17:08:01.550811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.550766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"0e0190c378d4f17956cf7e249c4c29415ee33bbc82a8af58cf92fdb7213b1053"} Jun 10 17:08:01.553447 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.553406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vbxmr" event={"ID":"1775aeee-3738-4f90-869d-70ab84ae8023","Type":"ContainerStarted","Data":"9ceec062b80a2af54f51b387c947d40f248f8ac717a0ae370c2b0602c97fc39e"} Jun 10 17:08:01.553562 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.553474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vbxmr" event={"ID":"1775aeee-3738-4f90-869d-70ab84ae8023","Type":"ContainerStarted","Data":"42c1ba4d6990795189b73deecda3857ff9cea5a21927e050b2050a65d8cb11a7"} Jun 10 17:08:01.583542 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.583488 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vbxmr" podStartSLOduration=2.611664211 podStartE2EDuration="3.58347273s" totalImagesPullingTime="907.146728ms" totalInitContainerRuntime="64.661791ms" isStatefulPod=true podCreationTimestamp="2026-06-10 17:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:01.582165756 +0000 UTC m=+62.730712896" watchObservedRunningTime="2026-06-10 17:08:01.58347273 +0000 UTC m=+62.732019882" Jun 10 17:08:01.648668 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.648606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:01.751833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.751796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:01.910466 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.910432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:01.978768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:01.978726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:02.108743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.108711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:02.395135 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.395031 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:02.498430 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.498397 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:02.558666 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.558627 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" event={"ID":"0e01c5b7-bf07-4e74-9619-b9460469f402","Type":"ContainerStarted","Data":"cfbaa1af072d8e93691dac04f8e05a0bee8c3b671ab201808757b4590a219307"} Jun 10 17:08:02.559129 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.558698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" event={"ID":"0e01c5b7-bf07-4e74-9619-b9460469f402","Type":"ContainerStarted","Data":"bb05e4c17aa8172985fac68ac773073524f3565fe3b247ec5ff6844d2ba676f4"} Jun 10 17:08:02.559129 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.558717 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" event={"ID":"0e01c5b7-bf07-4e74-9619-b9460469f402","Type":"ContainerStarted","Data":"63af40784a090998a128a6688193569b18fd00ef804801afcaf61d0a6bd26a8e"} Jun 10 17:08:02.560218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.560194 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5" exitCode=0 Jun 10 17:08:02.560319 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.560274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5"} Jun 10 17:08:02.588873 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.588837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:02.613233 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:02.613175 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rrvsc" podStartSLOduration=2.854052053 podStartE2EDuration="4.613155369s" totalImagesPullingTime="1.759103316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:02.582550044 +0000 UTC m=+63.731097159" watchObservedRunningTime="2026-06-10 17:08:02.613155369 +0000 UTC m=+63.761702485" Jun 10 17:08:03.608734 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:03.608696 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:03.698143 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:03.698103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:03.817593 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:03.817548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:05.144525 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.144495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:08:05.144853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.144540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:08:05.147379 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.147360 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 17:08:05.147469 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.147395 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 17:08:05.156985 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.156962 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c808093-3f6d-43df-9b92-b1930c61e98b-original-pull-secret\") pod \"global-pull-secret-syncer-s5b62\" (UID: \"7c808093-3f6d-43df-9b92-b1930c61e98b\") " pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:08:05.157113 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.157045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30c72e5d-deeb-4940-85a3-8b0deb9161e5-metrics-certs\") pod \"network-metrics-daemon-lwb8p\" (UID: \"30c72e5d-deeb-4940-85a3-8b0deb9161e5\") " pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:08:05.201562 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.201385 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:08:05.205439 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.205393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:05.218601 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.217502 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.222217 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.222167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 17:08:05.222338 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.222299 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 17:08:05.222413 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.222299 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 17:08:05.222720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.222690 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5d298\"" Jun 10 17:08:05.223811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.223352 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 17:08:05.223811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.223606 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 17:08:05.223811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.223678 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 17:08:05.223811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.223777 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 17:08:05.223811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.223607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 17:08:05.224739 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.224709 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 17:08:05.226285 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.225299 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 17:08:05.226285 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.225549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 17:08:05.226285 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.225797 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 17:08:05.226285 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.225997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-doegu2nb2la9e\"" Jun 10 17:08:05.226285 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.226176 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 17:08:05.227267 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.227183 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:08:05.229137 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.229112 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 17:08:05.245782 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.245761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:08:05.246670 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.246637 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 17:08:05.248703 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.248682 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 17:08:05.259068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.259050 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 17:08:05.269443 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.269401 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvtg\" (UniqueName: \"kubernetes.io/projected/9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e-kube-api-access-jfvtg\") pod \"network-check-target-dwsvb\" (UID: \"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e\") " pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:08:05.347016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.346939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.346980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqdrs\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.347549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.347486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.406638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.406597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5b62" Jun 10 17:08:05.415531 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.415499 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m7vsv\"" Jun 10 17:08:05.419023 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.418993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwf4k\"" Jun 10 17:08:05.423631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.423606 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwb8p" Jun 10 17:08:05.426841 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.426824 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:08:05.449549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqdrs\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.449981 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.449984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450513 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450855 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450909 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.450975 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.450957 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.452688 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.452158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.453861 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.453836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.454596 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.454464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.455091 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.454860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.455496 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.455477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.456437 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.456305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.456437 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.456395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.457006 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.456964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.457006 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.456987 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.457154 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.457086 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.457154 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.457135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.457304 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.457281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.458379 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.458354 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.459029 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.458989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.461852 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.461576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqdrs\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs\") pod \"prometheus-k8s-0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.530579 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.530217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.588937 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee"} Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.589181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0"} Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.589238 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e"} Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.589280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac"} Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.589317 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1"} Jun 10 17:08:05.589911 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.589461 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5b62"] Jun 10 17:08:05.660153 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.660118 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwb8p"] Jun 10 17:08:05.672929 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.669182 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dwsvb"] Jun 10 17:08:05.672929 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:08:05.669298 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c72e5d_deeb_4940_85a3_8b0deb9161e5.slice/crio-11ffefcc74e3e90f5e3efed4b686cbe349ee1f31e1fde6ae1ee97bf2d9163a10 WatchSource:0}: Error finding container 11ffefcc74e3e90f5e3efed4b686cbe349ee1f31e1fde6ae1ee97bf2d9163a10: Status 404 returned error can't find the container with id 11ffefcc74e3e90f5e3efed4b686cbe349ee1f31e1fde6ae1ee97bf2d9163a10 Jun 10 17:08:05.681434 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:08:05.681379 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea3b280_06c7_419b_b0d0_ae62bcd3bc5e.slice/crio-5c90665cc9bd16814fe30a35e79c69e92b7232aaf0b41572fea639818582c70c WatchSource:0}: Error finding container 5c90665cc9bd16814fe30a35e79c69e92b7232aaf0b41572fea639818582c70c: Status 404 returned error can't find the container with id 5c90665cc9bd16814fe30a35e79c69e92b7232aaf0b41572fea639818582c70c Jun 10 17:08:05.740956 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:05.740924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:08:05.744541 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:08:05.744506 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f24006_14df_4523_824e_6882664515a0.slice/crio-80936182060d76f79795c6ccaf62f4c95d38d7e1b817cbe9b08fdb02d773b6c2 WatchSource:0}: Error finding container 80936182060d76f79795c6ccaf62f4c95d38d7e1b817cbe9b08fdb02d773b6c2: Status 404 returned error can't find the container with id 80936182060d76f79795c6ccaf62f4c95d38d7e1b817cbe9b08fdb02d773b6c2 Jun 10 17:08:06.599295 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.599258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerStarted","Data":"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155"} Jun 10 17:08:06.601886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.601722 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" exitCode=0 Jun 10 17:08:06.601886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.601833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} Jun 10 17:08:06.602049 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.601908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"80936182060d76f79795c6ccaf62f4c95d38d7e1b817cbe9b08fdb02d773b6c2"} Jun 10 17:08:06.604201 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.604103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dwsvb" event={"ID":"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e","Type":"ContainerStarted","Data":"5c90665cc9bd16814fe30a35e79c69e92b7232aaf0b41572fea639818582c70c"} Jun 10 17:08:06.607253 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.607224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5b62" event={"ID":"7c808093-3f6d-43df-9b92-b1930c61e98b","Type":"ContainerStarted","Data":"5cf931206ee332e7e0365dea24657d4257cdc3261fdde49ec8e784a8413ad66f"} Jun 10 17:08:06.608626 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.608599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwb8p" event={"ID":"30c72e5d-deeb-4940-85a3-8b0deb9161e5","Type":"ContainerStarted","Data":"11ffefcc74e3e90f5e3efed4b686cbe349ee1f31e1fde6ae1ee97bf2d9163a10"} Jun 10 17:08:06.633720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:06.631922 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.986362438 podStartE2EDuration="7.631901707s" totalImagesPullingTime="3.623654113s" totalInitContainerRuntime="21.885156ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:07:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:06.630443237 +0000 UTC m=+67.778990378" watchObservedRunningTime="2026-06-10 17:08:06.631901707 +0000 UTC m=+67.780448828" Jun 10 17:08:07.493762 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.493730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b5d84cd5c-8wzpj" Jun 10 17:08:07.616386 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.616340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwb8p" event={"ID":"30c72e5d-deeb-4940-85a3-8b0deb9161e5","Type":"ContainerStarted","Data":"b7d29e363487e150c762e295024e2a5da5f43ac7cb62009e8116236a31c06cb0"} Jun 10 17:08:07.616837 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.616417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwb8p" event={"ID":"30c72e5d-deeb-4940-85a3-8b0deb9161e5","Type":"ContainerStarted","Data":"6927c053dabf66a7d659c49da07d1e3f97f3ac3433b5493fb6a49a5c9c6742b9"} Jun 10 17:08:07.637738 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.637676 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lwb8p" podStartSLOduration=67.665183714 podStartE2EDuration="1m8.637638556s" totalImagesPullingTime="972.454842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:07.63624018 +0000 UTC m=+68.784787320" watchObservedRunningTime="2026-06-10 17:08:07.637638556 +0000 UTC m=+68.786185673" Jun 10 17:08:07.648482 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.648451 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:07.756516 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.756427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:07.842573 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.842506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:07.943485 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:07.943419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:08.726011 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:08.725941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:08.785212 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:08.785176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:11.396297 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.396146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:11.453853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.453798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:11.634587 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.634563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} Jun 10 17:08:11.636076 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.636051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dwsvb" event={"ID":"9ea3b280-06c7-419b-b0d0-ae62bcd3bc5e","Type":"ContainerStarted","Data":"6b139e9b22d6b450a915535f6ffb2f9994d55956d7721ca62f5a5ff277f0b25f"} Jun 10 17:08:11.636339 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.636297 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:08:11.637512 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.637490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5b62" event={"ID":"7c808093-3f6d-43df-9b92-b1930c61e98b","Type":"ContainerStarted","Data":"6b4f8d4a91a08ff78d67a01ec58b9d0a4d2a1c3b7461cd02706cabb460239e5e"} Jun 10 17:08:11.653060 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.653015 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dwsvb" podStartSLOduration=66.814510212 podStartE2EDuration="1m12.653001257s" totalImagesPullingTime="5.838491045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:11.652079055 +0000 UTC m=+72.800626197" watchObservedRunningTime="2026-06-10 17:08:11.653001257 +0000 UTC m=+72.801548373" Jun 10 17:08:11.665993 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.665939 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:11.668680 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.668618 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s5b62" podStartSLOduration=66.738492568 podStartE2EDuration="1m12.668601944s" totalImagesPullingTime="5.930109376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:11.667944623 +0000 UTC m=+72.816491740" watchObservedRunningTime="2026-06-10 17:08:11.668601944 +0000 UTC m=+72.817149062" Jun 10 17:08:11.726616 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:11.726554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:12.188222 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:12.188173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:12.273146 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:12.273116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:12.643587 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:12.643511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} Jun 10 17:08:13.651209 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.651135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} Jun 10 17:08:13.651614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.651200 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} Jun 10 17:08:13.651683 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.651635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} Jun 10 17:08:13.651723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.651685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerStarted","Data":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} Jun 10 17:08:13.689844 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.689773 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.155203268 podStartE2EDuration="8.689754293s" totalImagesPullingTime="6.514030734s" totalInitContainerRuntime="20.520291ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:08:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:08:13.687740389 +0000 UTC m=+74.836287505" watchObservedRunningTime="2026-06-10 17:08:13.689754293 +0000 UTC m=+74.838301412" Jun 10 17:08:13.969608 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:13.969577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:14.067988 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:14.067958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:14.236668 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:14.236566 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:14.436973 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:14.436943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:14.537239 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:14.537165 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:14.638122 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:14.638090 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:15.531362 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:15.531330 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:08:17.850835 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:17.850797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:17.909275 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:17.909231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:18.357281 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:18.357227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:28.961832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:28.961775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:29.024867 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:29.024811 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:35.341356 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:35.341321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:35.442201 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:35.442142 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:35.504544 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:35.504516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:08:42.646517 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:08:42.646482 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dwsvb" Jun 10 17:09:05.531437 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:05.531403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:05.550388 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:05.550361 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:05.858001 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:05.857929 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:15.835820 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:15.835784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:18.228220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:18.228183 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:18.716728 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:18.716690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.317430 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.317993 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="alertmanager" containerID="cri-o://3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" gracePeriod=120 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.318202 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-metric" containerID="cri-o://165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" gracePeriod=120 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.318496 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-web" containerID="cri-o://b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" gracePeriod=120 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.318646 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="config-reloader" containerID="cri-o://ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" gracePeriod=120 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.318731 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="prom-label-proxy" containerID="cri-o://20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" gracePeriod=120 Jun 10 17:09:19.321740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.318828 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy" containerID="cri-o://90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" gracePeriod=120 Jun 10 17:09:19.894625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894588 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" exitCode=0 Jun 10 17:09:19.894625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894616 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" exitCode=0 Jun 10 17:09:19.894625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894622 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" exitCode=0 Jun 10 17:09:19.894625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894629 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" exitCode=0 Jun 10 17:09:19.894897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155"} Jun 10 17:09:19.894897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0"} Jun 10 17:09:19.894897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894779 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac"} Jun 10 17:09:19.894897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:19.894802 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1"} Jun 10 17:09:20.561365 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.561341 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.592635 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592606 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.592635 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592641 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592686 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592715 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592778 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592814 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592836 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592876 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592932 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dgqj\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592969 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.593006 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.593508 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.593032 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\" (UID: \"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1\") " Jun 10 17:09:20.597953 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.592963 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:09:20.597953 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.593433 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:20.597953 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.594196 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:20.597953 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.597332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume" (OuterVolumeSpecName: "config-volume") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.598222 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.598180 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj" (OuterVolumeSpecName: "kube-api-access-6dgqj") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "kube-api-access-6dgqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:09:20.598804 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.598719 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:09:20.598804 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.598771 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.598957 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.598899 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.599250 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.599215 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.600121 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.599993 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.601443 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.601418 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out" (OuterVolumeSpecName: "config-out") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:09:20.604382 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.604354 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.612362 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.612333 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config" (OuterVolumeSpecName: "web-config") pod "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" (UID: "f892ddf6-e44d-4a5d-ae6e-c0f679643cf1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:20.694827 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694797 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-main-db\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.694827 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694824 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-main-tls\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.694827 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694834 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-metrics-client-ca\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694844 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694855 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-tls-assets\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694864 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694871 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-volume\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694880 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-web-config\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694888 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694897 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dgqj\" (UniqueName: \"kubernetes.io/projected/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-kube-api-access-6dgqj\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694905 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-cluster-tls-config\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694913 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-config-out\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.695039 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.694921 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:20.901422 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901386 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" exitCode=0 Jun 10 17:09:20.901422 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901416 2559 generic.go:356] "Generic (PLEG): container finished" podID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerID="b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" exitCode=0 Jun 10 17:09:20.901631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee"} Jun 10 17:09:20.901631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901481 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.901631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e"} Jun 10 17:09:20.901631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f892ddf6-e44d-4a5d-ae6e-c0f679643cf1","Type":"ContainerDied","Data":"0e0190c378d4f17956cf7e249c4c29415ee33bbc82a8af58cf92fdb7213b1053"} Jun 10 17:09:20.901631 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.901593 2559 scope.go:117] "RemoveContainer" containerID="20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" Jun 10 17:09:20.910217 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.910199 2559 scope.go:117] "RemoveContainer" containerID="165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" Jun 10 17:09:20.917065 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.917044 2559 scope.go:117] "RemoveContainer" containerID="90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" Jun 10 17:09:20.923637 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.923620 2559 scope.go:117] "RemoveContainer" containerID="b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" Jun 10 17:09:20.927906 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.927598 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:20.931065 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.931047 2559 scope.go:117] "RemoveContainer" containerID="ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" Jun 10 17:09:20.934491 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.934472 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:20.938441 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.938423 2559 scope.go:117] "RemoveContainer" containerID="3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" Jun 10 17:09:20.944970 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.944931 2559 scope.go:117] "RemoveContainer" containerID="9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5" Jun 10 17:09:20.951564 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.951549 2559 scope.go:117] "RemoveContainer" containerID="20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" Jun 10 17:09:20.951921 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.951889 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155\": container with ID starting with 20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155 not found: ID does not exist" containerID="20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" Jun 10 17:09:20.951982 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.951932 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155"} err="failed to get container status \"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155\": rpc error: code = NotFound desc = could not find container \"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155\": container with ID starting with 20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155 not found: ID does not exist" Jun 10 17:09:20.951982 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.951965 2559 scope.go:117] "RemoveContainer" containerID="165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" Jun 10 17:09:20.952194 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.952175 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee\": container with ID starting with 165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee not found: ID does not exist" containerID="165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" Jun 10 17:09:20.952236 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952198 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee"} err="failed to get container status \"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee\": rpc error: code = NotFound desc = could not find container \"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee\": container with ID starting with 165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee not found: ID does not exist" Jun 10 17:09:20.952236 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952213 2559 scope.go:117] "RemoveContainer" containerID="90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" Jun 10 17:09:20.952434 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.952415 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0\": container with ID starting with 90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0 not found: ID does not exist" containerID="90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" Jun 10 17:09:20.952496 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952444 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0"} err="failed to get container status \"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0\": rpc error: code = NotFound desc = could not find container \"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0\": container with ID starting with 90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0 not found: ID does not exist" Jun 10 17:09:20.952496 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952467 2559 scope.go:117] "RemoveContainer" containerID="b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" Jun 10 17:09:20.952751 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.952737 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e\": container with ID starting with b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e not found: ID does not exist" containerID="b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" Jun 10 17:09:20.952798 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952755 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e"} err="failed to get container status \"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e\": rpc error: code = NotFound desc = could not find container \"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e\": container with ID starting with b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e not found: ID does not exist" Jun 10 17:09:20.952798 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952768 2559 scope.go:117] "RemoveContainer" containerID="ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" Jun 10 17:09:20.952981 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.952962 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac\": container with ID starting with ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac not found: ID does not exist" containerID="ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" Jun 10 17:09:20.953023 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.952989 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac"} err="failed to get container status \"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac\": rpc error: code = NotFound desc = could not find container \"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac\": container with ID starting with ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac not found: ID does not exist" Jun 10 17:09:20.953023 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953009 2559 scope.go:117] "RemoveContainer" containerID="3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" Jun 10 17:09:20.953243 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.953226 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1\": container with ID starting with 3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1 not found: ID does not exist" containerID="3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" Jun 10 17:09:20.953297 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953250 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1"} err="failed to get container status \"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1\": rpc error: code = NotFound desc = could not find container \"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1\": container with ID starting with 3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1 not found: ID does not exist" Jun 10 17:09:20.953297 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953269 2559 scope.go:117] "RemoveContainer" containerID="9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5" Jun 10 17:09:20.953473 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:20.953459 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5\": container with ID starting with 9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5 not found: ID does not exist" containerID="9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5" Jun 10 17:09:20.953511 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953476 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5"} err="failed to get container status \"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5\": rpc error: code = NotFound desc = could not find container \"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5\": container with ID starting with 9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5 not found: ID does not exist" Jun 10 17:09:20.953511 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953488 2559 scope.go:117] "RemoveContainer" containerID="20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155" Jun 10 17:09:20.953733 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953708 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155"} err="failed to get container status \"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155\": rpc error: code = NotFound desc = could not find container \"20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155\": container with ID starting with 20b612f3913f16f328f7461e303bae96c518d2e65a692d6700cfd5a4f3c52155 not found: ID does not exist" Jun 10 17:09:20.953733 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953732 2559 scope.go:117] "RemoveContainer" containerID="165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee" Jun 10 17:09:20.953980 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953961 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee"} err="failed to get container status \"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee\": rpc error: code = NotFound desc = could not find container \"165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee\": container with ID starting with 165b51df6034670d2afb6254f2bff65164b1d4f44785ed855454705f718a4aee not found: ID does not exist" Jun 10 17:09:20.954023 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.953982 2559 scope.go:117] "RemoveContainer" containerID="90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0" Jun 10 17:09:20.954206 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954188 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0"} err="failed to get container status \"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0\": rpc error: code = NotFound desc = could not find container \"90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0\": container with ID starting with 90b5a63040998bb7e348526dffc99a6468e6e518efa89b9dfa321d019e42fbf0 not found: ID does not exist" Jun 10 17:09:20.954256 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954206 2559 scope.go:117] "RemoveContainer" containerID="b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e" Jun 10 17:09:20.954403 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954389 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e"} err="failed to get container status \"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e\": rpc error: code = NotFound desc = could not find container \"b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e\": container with ID starting with b45919f500c440a0fad1cb4b677e10a470d0680be4b0764eabd31f47328ce66e not found: ID does not exist" Jun 10 17:09:20.954453 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954403 2559 scope.go:117] "RemoveContainer" containerID="ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac" Jun 10 17:09:20.954572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954554 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac"} err="failed to get container status \"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac\": rpc error: code = NotFound desc = could not find container \"ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac\": container with ID starting with ec59a57a9d8ad5713d72e91c433a23ced2973b7831e990f4b4c8ac133544e0ac not found: ID does not exist" Jun 10 17:09:20.954613 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954572 2559 scope.go:117] "RemoveContainer" containerID="3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1" Jun 10 17:09:20.954812 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954793 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1"} err="failed to get container status \"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1\": rpc error: code = NotFound desc = could not find container \"3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1\": container with ID starting with 3a6d28f6eeffddfd356968e3ac76937eb52832bad27a75b2be521af91cd57ea1 not found: ID does not exist" Jun 10 17:09:20.954860 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.954812 2559 scope.go:117] "RemoveContainer" containerID="9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5" Jun 10 17:09:20.955032 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.955016 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5"} err="failed to get container status \"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5\": rpc error: code = NotFound desc = could not find container \"9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5\": container with ID starting with 9435d2c238b7a7950e090d935c681c51adb28ae030491b6d525cfeebe8aa7ef5 not found: ID does not exist" Jun 10 17:09:20.966581 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966553 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:20.966838 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966825 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="config-reloader" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966840 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="config-reloader" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966854 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966859 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966867 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-web" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966873 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-web" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966880 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="alertmanager" Jun 10 17:09:20.966886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966886 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="alertmanager" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966894 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="init-config-reloader" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966900 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="init-config-reloader" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966907 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="prom-label-proxy" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966912 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="prom-label-proxy" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966925 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-metric" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966930 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-metric" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966969 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-web" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966978 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966984 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="alertmanager" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966989 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="config-reloader" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.966994 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="prom-label-proxy" Jun 10 17:09:20.967079 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.967000 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" containerName="kube-rbac-proxy-metric" Jun 10 17:09:20.970349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.970331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.973096 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973073 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 17:09:20.973096 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973094 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 17:09:20.973292 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973244 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 17:09:20.973292 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973268 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 17:09:20.973456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 17:09:20.973456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 17:09:20.973587 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973556 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 17:09:20.973587 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973564 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 17:09:20.973741 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.973613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kzgjb\"" Jun 10 17:09:20.979352 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.979326 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 17:09:20.985791 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.985770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:20.997009 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.996985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997105 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997105 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-out\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997105 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997207 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997207 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997207 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997207 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997322 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vvt\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-kube-api-access-62vvt\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997322 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997322 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997322 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-web-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:20.997434 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:20.997328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098048 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098048 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098288 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-out\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098288 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098288 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098444 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098444 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098444 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vvt\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-kube-api-access-62vvt\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.098611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-web-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.099041 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.098627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.099722 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.099355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.099722 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.099566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.099993 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.099967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.100903 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.100878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-out\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.101197 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.101147 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.101312 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.101209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.101312 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.101269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.101670 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.101613 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.102207 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.102183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.102303 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.102288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-web-config\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.102405 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.102389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.102456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.102442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.110244 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.110227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vvt\" (UniqueName: \"kubernetes.io/projected/3eea43e0-7a76-4549-aea2-f03d0f5e2d0d-kube-api-access-62vvt\") pod \"alertmanager-main-0\" (UID: \"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.279885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.279803 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 17:09:21.300731 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.300703 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f892ddf6-e44d-4a5d-ae6e-c0f679643cf1" path="/var/lib/kubelet/pods/f892ddf6-e44d-4a5d-ae6e-c0f679643cf1/volumes" Jun 10 17:09:21.422933 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.422902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 17:09:21.426009 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:09:21.425984 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eea43e0_7a76_4549_aea2_f03d0f5e2d0d.slice/crio-959fed248fd9c9f3bacce55df5c5c016e2e58c65406069f2081d89e7fab0b01e WatchSource:0}: Error finding container 959fed248fd9c9f3bacce55df5c5c016e2e58c65406069f2081d89e7fab0b01e: Status 404 returned error can't find the container with id 959fed248fd9c9f3bacce55df5c5c016e2e58c65406069f2081d89e7fab0b01e Jun 10 17:09:21.907640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.907610 2559 generic.go:356] "Generic (PLEG): container finished" podID="3eea43e0-7a76-4549-aea2-f03d0f5e2d0d" containerID="752aea38c712dfbf00486ccf180eb074e6fa01bea87b2c351c9af47a98289e8f" exitCode=0 Jun 10 17:09:21.908045 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.907687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerDied","Data":"752aea38c712dfbf00486ccf180eb074e6fa01bea87b2c351c9af47a98289e8f"} Jun 10 17:09:21.908045 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:21.907758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"959fed248fd9c9f3bacce55df5c5c016e2e58c65406069f2081d89e7fab0b01e"} Jun 10 17:09:22.915038 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"d5cc5ca436e685e6363fe07ea30e6e8da90da702def67377b1ca9f9dc64827ca"} Jun 10 17:09:22.915383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915071 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"6e70bbc70c3823c075f78c79f0a75a70942680daed7f0493689ae8828fa0109b"} Jun 10 17:09:22.915383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"7b9b3157e40b36c2086bc10c5ca028f8a12cdab5dc0ee86e59579cfd6482869b"} Jun 10 17:09:22.915383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915123 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"1e8dd18292e07455e97f8a9c5cddd8d14376f9e671c652f00a9d9ed58ea4172a"} Jun 10 17:09:22.915383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"12c443f64505d0c2e4e6db51309e15e451f038e185ac34c6bfde8edc3b7a5bcf"} Jun 10 17:09:22.915383 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.915173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3eea43e0-7a76-4549-aea2-f03d0f5e2d0d","Type":"ContainerStarted","Data":"62490b3502c12d6c9d1a4312a47fa0760d5534b5538f8cb6f72b506361e81ef7"} Jun 10 17:09:22.948494 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:22.948181 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.933116463 podStartE2EDuration="2.948157844s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.041381ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:09:22.946091229 +0000 UTC m=+144.094638347" watchObservedRunningTime="2026-06-10 17:09:22.948157844 +0000 UTC m=+144.096704960" Jun 10 17:09:23.624773 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.624735 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:23.625473 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.625435 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="prometheus" containerID="cri-o://311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" gracePeriod=600 Jun 10 17:09:23.626036 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.626008 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" gracePeriod=600 Jun 10 17:09:23.626477 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.626193 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="thanos-sidecar" containerID="cri-o://31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" gracePeriod=600 Jun 10 17:09:23.626598 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.626219 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-web" containerID="cri-o://37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" gracePeriod=600 Jun 10 17:09:23.626684 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.626236 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="config-reloader" containerID="cri-o://85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" gracePeriod=600 Jun 10 17:09:23.626767 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.626234 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy" containerID="cri-o://629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" gracePeriod=600 Jun 10 17:09:23.880540 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.880476 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.920849 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.920897 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.920926 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.920959 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.920990 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921023 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921052 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921077 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921101 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqdrs\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921140 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921174 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921215 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921246 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921269 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921298 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921324 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921350 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.921373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921382 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.922673 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921412 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.922673 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.921443 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca\") pod \"21f24006-14df-4523-824e-6882664515a0\" (UID: \"21f24006-14df-4523-824e-6882664515a0\") " Jun 10 17:09:23.922673 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.922009 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.922673 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.922458 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.924770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.923731 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:09:23.924770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.924130 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.925520 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.925048 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config" (OuterVolumeSpecName: "config") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.925520 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.925479 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.925520 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.925507 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.925892 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.925788 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.926134 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.925957 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:09:23.927873 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.927829 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.928283 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.928220 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.928528 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.928495 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out" (OuterVolumeSpecName: "config-out") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929348 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929402 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929422 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929433 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929441 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929449 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929457 2559 generic.go:356] "Generic (PLEG): container finished" podID="21f24006-14df-4523-824e-6882664515a0" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" exitCode=0 Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929488 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:23.929550 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929643 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21f24006-14df-4523-824e-6882664515a0","Type":"ContainerDied","Data":"80936182060d76f79795c6ccaf62f4c95d38d7e1b817cbe9b08fdb02d773b6c2"} Jun 10 17:09:23.930551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.929878 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.931251 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931113 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.931251 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931186 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs" (OuterVolumeSpecName: "kube-api-access-nqdrs") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "kube-api-access-nqdrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:09:23.931354 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931298 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.931510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931475 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.931625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931595 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.931852 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.931799 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.941121 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.941091 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.943393 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.943370 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config" (OuterVolumeSpecName: "web-config") pod "21f24006-14df-4523-824e-6882664515a0" (UID: "21f24006-14df-4523-824e-6882664515a0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:09:23.951408 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.951324 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.960403 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.960378 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.968355 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.968329 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.975192 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.975175 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.982510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.982492 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.988987 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.988968 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.989278 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.989259 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.989349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989291 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.989349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989311 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.989589 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.989568 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.989642 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989593 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.989642 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989608 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.989885 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.989868 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.989921 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989889 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.989921 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.989902 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.990101 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.990086 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.990140 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.990104 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:23.990140 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.990117 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.990310 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.990289 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.990378 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.990315 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:23.990378 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.990330 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.992679 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.992115 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.992679 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.992145 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:23.992679 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.992196 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.992866 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:09:23.992830 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.992866 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.992855 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:23.992957 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.992875 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.993308 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993290 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.993308 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993308 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.993532 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993511 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.993592 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993532 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.993783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993766 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.993850 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993783 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.994010 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.993992 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:23.994057 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994013 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.994266 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994250 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:23.994311 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994267 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.994453 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994438 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:23.994497 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994454 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.994636 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994620 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:23.994691 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994636 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.994832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994814 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.994870 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994833 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.994996 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994969 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.994996 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.994994 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.995234 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995217 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.995234 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995233 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.995436 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995412 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:23.995475 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995437 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.995629 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995612 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:23.995721 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995629 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.995890 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995870 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:23.995890 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.995889 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.996126 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996109 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:23.996201 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996126 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.996321 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996306 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.996359 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996322 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.996521 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996505 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.996521 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996520 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.996704 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996689 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.996801 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996706 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.996894 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996875 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:23.996932 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.996895 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.997095 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997080 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:23.997141 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997095 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.997300 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997280 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:23.997373 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997302 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.997504 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997488 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:23.997549 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997504 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.997724 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997704 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.997801 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997727 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.997966 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997950 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.998016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.997966 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.998162 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998144 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.998228 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998163 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:23.998334 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998317 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:23.998379 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998333 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:23.998506 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998489 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:23.998567 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998507 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:23.998755 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998740 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:23.998801 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998756 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:23.998962 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998944 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:23.999007 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.998962 2559 scope.go:117] "RemoveContainer" containerID="2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253" Jun 10 17:09:23.999184 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999166 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253"} err="failed to get container status \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": rpc error: code = NotFound desc = could not find container \"2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253\": container with ID starting with 2d647c9bdd08e7f41ddfa621988dc7fb0ac8383b6ac364e956d20c8dac8cc253 not found: ID does not exist" Jun 10 17:09:23.999255 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999187 2559 scope.go:117] "RemoveContainer" containerID="629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e" Jun 10 17:09:23.999423 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999403 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e"} err="failed to get container status \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": rpc error: code = NotFound desc = could not find container \"629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e\": container with ID starting with 629b447d2547978d0d6ef8171c81f773b746818ca96c612375b95843d6fba94e not found: ID does not exist" Jun 10 17:09:23.999486 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999424 2559 scope.go:117] "RemoveContainer" containerID="37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9" Jun 10 17:09:23.999774 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999740 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9"} err="failed to get container status \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": rpc error: code = NotFound desc = could not find container \"37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9\": container with ID starting with 37f726539f2e1bd8719ab10ab12c54f19c938dc2738c4dc7852b9f615c8d8be9 not found: ID does not exist" Jun 10 17:09:23.999774 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:23.999768 2559 scope.go:117] "RemoveContainer" containerID="31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57" Jun 10 17:09:24.000134 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000105 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57"} err="failed to get container status \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": rpc error: code = NotFound desc = could not find container \"31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57\": container with ID starting with 31673dedeae96856464e7904b2fb445e3c847558f58267fb878b0d81a0e1af57 not found: ID does not exist" Jun 10 17:09:24.000134 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000127 2559 scope.go:117] "RemoveContainer" containerID="85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1" Jun 10 17:09:24.000362 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000342 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1"} err="failed to get container status \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": rpc error: code = NotFound desc = could not find container \"85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1\": container with ID starting with 85cc711fbbab3115497c37067b72af6665cc3e339919b667bc0e69718a4450a1 not found: ID does not exist" Jun 10 17:09:24.000431 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000364 2559 scope.go:117] "RemoveContainer" containerID="311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49" Jun 10 17:09:24.000569 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000554 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49"} err="failed to get container status \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": rpc error: code = NotFound desc = could not find container \"311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49\": container with ID starting with 311799bf514fe91d3d359247f9f1450b3c41284501ec219701c0350787ef4c49 not found: ID does not exist" Jun 10 17:09:24.000616 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000570 2559 scope.go:117] "RemoveContainer" containerID="4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f" Jun 10 17:09:24.000803 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.000787 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f"} err="failed to get container status \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": rpc error: code = NotFound desc = could not find container \"4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f\": container with ID starting with 4ed6545ad360556aad9390412dbd6425bc501fce66a439a83a90f7f51d21100f not found: ID does not exist" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022406 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022438 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022454 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-tls-assets\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022468 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022484 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqdrs\" (UniqueName: \"kubernetes.io/projected/21f24006-14df-4523-824e-6882664515a0-kube-api-access-nqdrs\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022498 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022512 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-metrics-client-certs\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022526 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022540 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-web-config\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022557 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-grpc-tls\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022588 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022617 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-db\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.022614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022634 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-kube-rbac-proxy\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022676 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21f24006-14df-4523-824e-6882664515a0-config-out\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022692 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022708 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-configmap-metrics-client-ca\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022723 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022751 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022768 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/21f24006-14df-4523-824e-6882664515a0-config\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.023115 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.022783 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21f24006-14df-4523-824e-6882664515a0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:09:24.256119 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.256086 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:24.263566 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.263525 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:24.296047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296017 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:24.296270 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296258 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296271 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296281 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="config-reloader" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296287 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="config-reloader" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296294 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="thanos-sidecar" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296299 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="thanos-sidecar" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296307 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-thanos" Jun 10 17:09:24.296317 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296312 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-thanos" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296321 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-web" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296326 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-web" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296338 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="prometheus" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296343 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="prometheus" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296349 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="init-config-reloader" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296355 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="init-config-reloader" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296395 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-web" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296402 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="prometheus" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296407 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="thanos-sidecar" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296412 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296418 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="kube-rbac-proxy-thanos" Jun 10 17:09:24.296510 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.296423 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f24006-14df-4523-824e-6882664515a0" containerName="config-reloader" Jun 10 17:09:24.299700 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.299682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.302446 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.302425 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 17:09:24.303318 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303280 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 17:09:24.303318 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 17:09:24.303507 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 17:09:24.303507 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303328 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 17:09:24.303507 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-doegu2nb2la9e\"" Jun 10 17:09:24.303689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303560 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5d298\"" Jun 10 17:09:24.303689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 17:09:24.303689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303616 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 17:09:24.303689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303605 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 17:09:24.304047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 17:09:24.304047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.303930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 17:09:24.304047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.304003 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 17:09:24.304047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.304009 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 17:09:24.304345 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.304138 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 17:09:24.307913 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.307894 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 17:09:24.312862 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.312845 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 17:09:24.318592 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.318573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:24.325612 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-config-out\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325795 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325795 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8jmv\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-kube-api-access-w8jmv\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325961 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325961 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325961 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.325961 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326072 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.325987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326072 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-web-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326072 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326072 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326104 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.326187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.326165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427156 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427156 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-web-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.427389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.428044 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.427993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-config-out\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8jmv\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-kube-api-access-w8jmv\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.429089 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.428845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.430534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.430353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-web-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.430534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.430421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.430534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.430439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.430534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.430505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.430798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-config\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.431933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.432557 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.432855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/846208f0-d187-4113-9704-53bc6cd76edd-config-out\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.432949 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.432944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846208f0-d187-4113-9704-53bc6cd76edd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.433380 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.432968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.433380 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.433314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.434625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.434601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846208f0-d187-4113-9704-53bc6cd76edd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.444810 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.444789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8jmv\" (UniqueName: \"kubernetes.io/projected/846208f0-d187-4113-9704-53bc6cd76edd-kube-api-access-w8jmv\") pod \"prometheus-k8s-0\" (UID: \"846208f0-d187-4113-9704-53bc6cd76edd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.611749 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.611665 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:24.753416 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.753363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:09:24.755713 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:09:24.755683 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846208f0_d187_4113_9704_53bc6cd76edd.slice/crio-4a7b0d4d28cdd5fb34f44bb3dc65a029a89e6986b556884821cbc937947698a5 WatchSource:0}: Error finding container 4a7b0d4d28cdd5fb34f44bb3dc65a029a89e6986b556884821cbc937947698a5: Status 404 returned error can't find the container with id 4a7b0d4d28cdd5fb34f44bb3dc65a029a89e6986b556884821cbc937947698a5 Jun 10 17:09:24.935639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.935598 2559 generic.go:356] "Generic (PLEG): container finished" podID="846208f0-d187-4113-9704-53bc6cd76edd" containerID="8670083bc97eb7dbdd2573ee47fa8535e3671ba0fbf8b2c00d14f17ba41b02ea" exitCode=0 Jun 10 17:09:24.936120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.935691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerDied","Data":"8670083bc97eb7dbdd2573ee47fa8535e3671ba0fbf8b2c00d14f17ba41b02ea"} Jun 10 17:09:24.936120 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:24.935787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"4a7b0d4d28cdd5fb34f44bb3dc65a029a89e6986b556884821cbc937947698a5"} Jun 10 17:09:25.302109 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.302079 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f24006-14df-4523-824e-6882664515a0" path="/var/lib/kubelet/pods/21f24006-14df-4523-824e-6882664515a0/volumes" Jun 10 17:09:25.943005 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.942974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"e69db7e9186f31d753f28e493ebfccf1a92e24ea964bd9b64cc28cae4a75acb2"} Jun 10 17:09:25.943397 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.943039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"5f309741cefcd74d0513a6cab85d1284843975dfe3e7f0ae6c94c1b470b921a4"} Jun 10 17:09:25.943397 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.943066 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"89876affe7ccde6563c57303db1f1870121442a7daf83ec320b07bce0acf3ea3"} Jun 10 17:09:25.943397 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.943091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"a98bdfb7fa8fe92bf119c8a6503c8eb8973e0e52a7890b5cf7161fee5aa963fc"} Jun 10 17:09:25.943397 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.943115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"20704dea4129682d62c850ddb28e60e43c509c5a3b6db2cdc1cf9312cd3f2bf2"} Jun 10 17:09:25.943397 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.943139 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"846208f0-d187-4113-9704-53bc6cd76edd","Type":"ContainerStarted","Data":"d2dcf92df1d75c44bbd106cecf34c5ed5fb8d650239f3de39c3258bef33f976b"} Jun 10 17:09:25.976036 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:25.975979 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9570096829999999 podStartE2EDuration="1.975957226s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.947543ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:09:25.974154643 +0000 UTC m=+147.122701794" watchObservedRunningTime="2026-06-10 17:09:25.975957226 +0000 UTC m=+147.124504343" Jun 10 17:09:29.077384 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:29.077353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:29.178287 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:29.178256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:29.280105 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:29.280064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:29.611895 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:29.611864 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:09:29.822091 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:29.822055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:39.546472 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:39.546437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:39.653753 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:39.653673 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:09:39.754990 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:09:39.754959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:08.513297 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:08.513265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:08.614381 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:08.614356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:24.611832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:24.611798 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:10:24.628016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:24.627992 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:10:25.174365 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:25.174341 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:10:33.498552 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:33.498514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:33.559011 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:33.558987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:45.455040 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:45.455012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:45.510581 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:45.510554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:49.229884 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:49.229849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:52.797287 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:52.797257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:52.896349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:52.896319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:53.084709 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:53.084601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:53.143248 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:53.143221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:59.783874 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:59.783827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:59.841867 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:59.841836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:10:59.901336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:10:59.901295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:13.750686 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:13.750589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:15.049977 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:15.049944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:40.062233 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:40.062185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:41.407328 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:41.407292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:43.693723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:43.693687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:43.791591 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:43.791556 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:45.752349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:45.752316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:45.840664 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:45.840622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:46.215381 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:46.215350 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:46.312180 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:46.312152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:49.073095 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:49.073066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:49.672085 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:49.672032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:50.680423 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:50.680390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:50.737605 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:50.737575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:54.561714 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:54.561681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:54.661563 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:54.661528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:57.478038 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:57.477999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:58.614855 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:58.614818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:58.723080 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:58.723053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:11:59.254356 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:59.254321 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:11:59.255662 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:59.255625 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:11:59.257100 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:59.257073 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 17:11:59.519360 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:11:59.519298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:05.621840 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:05.621806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:05.725408 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:05.725366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:07.679996 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:07.679967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:23.119596 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:23.119564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:23.215537 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:23.211569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:23.732677 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:23.732617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:23.954210 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:23.954174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.051954 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.051866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.102936 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.102902 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q"] Jun 10 17:12:24.106420 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.106399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.109076 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.109053 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 17:12:24.109273 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.109254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 17:12:24.109369 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.109344 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 17:12:24.109369 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.109347 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sp29b\"" Jun 10 17:12:24.109619 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.109603 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 17:12:24.111440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.111421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.111534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.111458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr6m\" (UniqueName: \"kubernetes.io/projected/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-kube-api-access-pkr6m\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.111584 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.111560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.111622 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.111598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-tmp\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.111698 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.111683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-manifests\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.119719 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.119699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q"] Jun 10 17:12:24.209638 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.209606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.212727 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.212708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.212777 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.212737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-tmp\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.212777 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.212762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-manifests\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.212861 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.212814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.212861 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.212846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr6m\" (UniqueName: \"kubernetes.io/projected/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-kube-api-access-pkr6m\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.213236 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.213211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-manifests\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.214998 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.214973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-tmp\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.215110 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.215058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.215157 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.215129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.229483 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.229450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr6m\" (UniqueName: \"kubernetes.io/projected/9a32a1a6-2668-4285-bbc2-abfa3b83a9e1-kube-api-access-pkr6m\") pod \"opendatahub-operator-controller-manager-68f955fdfd-k9r8q\" (UID: \"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.308061 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.307967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.407860 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.407818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.416954 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.416933 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:24.508741 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.508714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:24.553187 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.553158 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q"] Jun 10 17:12:24.557388 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:12:24.557363 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a32a1a6_2668_4285_bbc2_abfa3b83a9e1.slice/crio-6e3036d7a43fdd98e54085494356ae6b517315cb29916c84e3d77799c14754a6 WatchSource:0}: Error finding container 6e3036d7a43fdd98e54085494356ae6b517315cb29916c84e3d77799c14754a6: Status 404 returned error can't find the container with id 6e3036d7a43fdd98e54085494356ae6b517315cb29916c84e3d77799c14754a6 Jun 10 17:12:24.559174 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.559154 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:12:24.576718 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.576696 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" event={"ID":"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1","Type":"ContainerStarted","Data":"6e3036d7a43fdd98e54085494356ae6b517315cb29916c84e3d77799c14754a6"} Jun 10 17:12:24.610628 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:24.610604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:27.591215 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:27.591178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" event={"ID":"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1","Type":"ContainerStarted","Data":"fd4f7f5f22aa274738fa63fd8b4aed214c884944418e78621a8e90cd67ea3375"} Jun 10 17:12:28.596124 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:28.596093 2559 generic.go:356] "Generic (PLEG): container finished" podID="9a32a1a6-2668-4285-bbc2-abfa3b83a9e1" containerID="fd4f7f5f22aa274738fa63fd8b4aed214c884944418e78621a8e90cd67ea3375" exitCode=0 Jun 10 17:12:28.596496 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:28.596159 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" event={"ID":"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1","Type":"ContainerDied","Data":"fd4f7f5f22aa274738fa63fd8b4aed214c884944418e78621a8e90cd67ea3375"} Jun 10 17:12:29.601148 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:29.601113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" event={"ID":"9a32a1a6-2668-4285-bbc2-abfa3b83a9e1","Type":"ContainerStarted","Data":"f723dbbdb8ea6b992c4b059a0c8a4daeab41a6d08bca207b02f4d7808f1bd9ff"} Jun 10 17:12:29.601706 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:29.601232 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:29.625692 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:29.625628 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" podStartSLOduration=1.473122026 podStartE2EDuration="5.625613962s" totalImagesPullingTime="3.199965326s" totalInitContainerRuntime="952.52661ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:12:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:12:29.623129223 +0000 UTC m=+330.771676339" watchObservedRunningTime="2026-06-10 17:12:29.625613962 +0000 UTC m=+330.774161078" Jun 10 17:12:38.071442 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:38.071407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:38.173015 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:38.172982 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:40.607809 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:40.607740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f955fdfd-k9r8q" Jun 10 17:12:41.925469 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.925424 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj"] Jun 10 17:12:41.930773 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.930752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:41.933429 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.933410 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 17:12:41.933547 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.933412 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:12:41.934824 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.934798 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 17:12:41.934944 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.934853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 17:12:41.935029 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.935007 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 17:12:41.935141 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.935069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rtpkz\"" Jun 10 17:12:41.937506 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:41.937481 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj"] Jun 10 17:12:42.053239 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.053210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/750a2180-0b6f-4880-9d9e-25848feedd20-manager-config\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.053400 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.053247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-metrics-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.053400 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.053268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.053400 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.053382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgmn2\" (UniqueName: \"kubernetes.io/projected/750a2180-0b6f-4880-9d9e-25848feedd20-kube-api-access-rgmn2\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.154121 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.154091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/750a2180-0b6f-4880-9d9e-25848feedd20-manager-config\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.154254 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.154132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-metrics-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.154254 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.154150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.154254 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.154196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgmn2\" (UniqueName: \"kubernetes.io/projected/750a2180-0b6f-4880-9d9e-25848feedd20-kube-api-access-rgmn2\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.154881 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.154860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/750a2180-0b6f-4880-9d9e-25848feedd20-manager-config\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.156738 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.156706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.156824 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.156765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/750a2180-0b6f-4880-9d9e-25848feedd20-metrics-cert\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.163687 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.163666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgmn2\" (UniqueName: \"kubernetes.io/projected/750a2180-0b6f-4880-9d9e-25848feedd20-kube-api-access-rgmn2\") pod \"lws-controller-manager-846d788f49-p6rlj\" (UID: \"750a2180-0b6f-4880-9d9e-25848feedd20\") " pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.240541 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.240496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:42.364687 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.364644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj"] Jun 10 17:12:42.367941 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:12:42.367892 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750a2180_0b6f_4880_9d9e_25848feedd20.slice/crio-e8877f71a5641892dbb9ba48ea8f42a093ca0f6fbbee04731b3fdd621833e30e WatchSource:0}: Error finding container e8877f71a5641892dbb9ba48ea8f42a093ca0f6fbbee04731b3fdd621833e30e: Status 404 returned error can't find the container with id e8877f71a5641892dbb9ba48ea8f42a093ca0f6fbbee04731b3fdd621833e30e Jun 10 17:12:42.536093 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.536012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:42.646827 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.646792 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:42.649041 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:42.649016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" event={"ID":"750a2180-0b6f-4880-9d9e-25848feedd20","Type":"ContainerStarted","Data":"e8877f71a5641892dbb9ba48ea8f42a093ca0f6fbbee04731b3fdd621833e30e"} Jun 10 17:12:43.268119 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.268066 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-b6d9c"] Jun 10 17:12:43.270578 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.270553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.273614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.273448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 17:12:43.273614 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.273488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2ndv4\"" Jun 10 17:12:43.284338 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.284316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-b6d9c"] Jun 10 17:12:43.316067 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.315988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:43.364524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.364486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.364524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.364525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4bm\" (UniqueName: \"kubernetes.io/projected/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-kube-api-access-2m4bm\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.401721 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.401686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:43.465044 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.464999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.465044 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.465041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4bm\" (UniqueName: \"kubernetes.io/projected/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-kube-api-access-2m4bm\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.465493 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:12:43.465348 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 17:12:43.465493 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:12:43.465426 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert podName:ba64dce2-8fcd-4575-9a2f-a836d7b214ae nodeName:}" failed. No retries permitted until 2026-06-10 17:12:43.965405051 +0000 UTC m=+345.113952144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert") pod "odh-model-controller-6dc94f689f-b6d9c" (UID: "ba64dce2-8fcd-4575-9a2f-a836d7b214ae") : secret "odh-model-controller-webhook-cert" not found Jun 10 17:12:43.476443 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.476411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4bm\" (UniqueName: \"kubernetes.io/projected/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-kube-api-access-2m4bm\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.502567 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.502535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:43.902679 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.902628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:43.970713 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.970681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.973371 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.973341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba64dce2-8fcd-4575-9a2f-a836d7b214ae-cert\") pod \"odh-model-controller-6dc94f689f-b6d9c\" (UID: \"ba64dce2-8fcd-4575-9a2f-a836d7b214ae\") " pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:43.999221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:43.999010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:44.185461 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:44.185408 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:44.548682 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:44.548585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:44.907104 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:44.907066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-b6d9c"] Jun 10 17:12:44.909741 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:12:44.909707 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba64dce2_8fcd_4575_9a2f_a836d7b214ae.slice/crio-7a84185f72133c85d4de2ae18a270831c343ed3cdfa7afa97ef37cf14b69fd75 WatchSource:0}: Error finding container 7a84185f72133c85d4de2ae18a270831c343ed3cdfa7afa97ef37cf14b69fd75: Status 404 returned error can't find the container with id 7a84185f72133c85d4de2ae18a270831c343ed3cdfa7afa97ef37cf14b69fd75 Jun 10 17:12:45.661264 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:45.661234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" event={"ID":"750a2180-0b6f-4880-9d9e-25848feedd20","Type":"ContainerStarted","Data":"8d4332c27dc71f8b446b376ad1e72b29e34df8d42f07dc0cdf8f267a78659f07"} Jun 10 17:12:45.661691 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:45.661306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:45.662456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:45.662433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" event={"ID":"ba64dce2-8fcd-4575-9a2f-a836d7b214ae","Type":"ContainerStarted","Data":"7a84185f72133c85d4de2ae18a270831c343ed3cdfa7afa97ef37cf14b69fd75"} Jun 10 17:12:45.683356 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:45.683306 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" podStartSLOduration=2.248271222 podStartE2EDuration="4.683292516s" totalImagesPullingTime="2.435021294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:12:45.681845805 +0000 UTC m=+346.830392923" watchObservedRunningTime="2026-06-10 17:12:45.683292516 +0000 UTC m=+346.831839699" Jun 10 17:12:48.677211 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:48.677179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" event={"ID":"ba64dce2-8fcd-4575-9a2f-a836d7b214ae","Type":"ContainerStarted","Data":"89eb883946d41e577772083910d5de7b820038c4bd95ab65e15988a31b95bcbb"} Jun 10 17:12:48.677568 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:48.677279 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:12:48.702914 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:48.702864 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" podStartSLOduration=2.51933759 podStartE2EDuration="5.702850232s" totalImagesPullingTime="3.183512642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:12:48.701940109 +0000 UTC m=+349.850487225" watchObservedRunningTime="2026-06-10 17:12:48.702850232 +0000 UTC m=+349.851397348" Jun 10 17:12:53.410586 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.410550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:53.483844 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.483807 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s"] Jun 10 17:12:53.485950 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.485921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:53.486069 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.486025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.488885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.488863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s2vnf\"" Jun 10 17:12:53.488885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.488863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 17:12:53.500499 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.500479 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s"] Jun 10 17:12:53.557082 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.557049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.557082 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.557085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8r67\" (UniqueName: \"kubernetes.io/projected/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-kube-api-access-t8r67\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.620472 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.620423 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:53.658477 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.658446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.658477 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.658481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8r67\" (UniqueName: \"kubernetes.io/projected/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-kube-api-access-t8r67\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.660933 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.660873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.677573 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.677546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8r67\" (UniqueName: \"kubernetes.io/projected/2d3c9461-1ca2-4562-a0ba-0c3ab2895759-kube-api-access-t8r67\") pod \"llmisvc-controller-manager-864bfd7bc9-z2b9s\" (UID: \"2d3c9461-1ca2-4562-a0ba-0c3ab2895759\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.725826 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.725794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:53.796041 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.796015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:53.846472 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.846443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:53.934775 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:53.934742 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s"] Jun 10 17:12:53.938182 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:12:53.938156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d3c9461_1ca2_4562_a0ba_0c3ab2895759.slice/crio-50336fdba475801f88811cc718a3fe1caea777486d0bc9a3a5c3c2d56c927e67 WatchSource:0}: Error finding container 50336fdba475801f88811cc718a3fe1caea777486d0bc9a3a5c3c2d56c927e67: Status 404 returned error can't find the container with id 50336fdba475801f88811cc718a3fe1caea777486d0bc9a3a5c3c2d56c927e67 Jun 10 17:12:54.693349 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:54.693320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:54.700695 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:54.700668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" event={"ID":"2d3c9461-1ca2-4562-a0ba-0c3ab2895759","Type":"ContainerStarted","Data":"50336fdba475801f88811cc718a3fe1caea777486d0bc9a3a5c3c2d56c927e67"} Jun 10 17:12:54.799366 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:54.799335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:54.890051 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:54.890010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:12:56.668375 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:56.668344 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-846d788f49-p6rlj" Jun 10 17:12:57.713672 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:57.713603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" event={"ID":"2d3c9461-1ca2-4562-a0ba-0c3ab2895759","Type":"ContainerStarted","Data":"114cd82d309dba2f38abc4f8b27ddb84c6831bc297539575a7fed1453aa46be3"} Jun 10 17:12:57.714082 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:57.713708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:12:57.742455 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:57.742408 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" podStartSLOduration=1.6602419579999999 podStartE2EDuration="4.742394807s" totalImagesPullingTime="3.082152849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:12:57.740371465 +0000 UTC m=+358.888918582" watchObservedRunningTime="2026-06-10 17:12:57.742394807 +0000 UTC m=+358.890941952" Jun 10 17:12:59.683624 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:12:59.683599 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-b6d9c" Jun 10 17:13:03.972921 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:03.972884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:04.077352 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:04.077322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:06.340943 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:06.340909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:06.439668 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:06.439629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:07.866031 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:07.865993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:08.075922 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:08.075886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:08.694394 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:08.694353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:08.803657 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:08.803628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:10.458836 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.458803 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7df97bdc96-mjc6n"] Jun 10 17:13:10.461085 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.461061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.463968 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.463940 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 17:13:10.464165 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.464152 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5tqt2\"" Jun 10 17:13:10.472919 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.472893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7df97bdc96-mjc6n"] Jun 10 17:13:10.487245 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.487214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:10.504428 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.504407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/97d3361d-b23a-48b3-9fde-543c07dc4fe2-redirect-config\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.504525 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.504469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tnlp\" (UniqueName: \"kubernetes.io/projected/97d3361d-b23a-48b3-9fde-543c07dc4fe2-kube-api-access-6tnlp\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.604853 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.604830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/97d3361d-b23a-48b3-9fde-543c07dc4fe2-redirect-config\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.604954 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.604881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tnlp\" (UniqueName: \"kubernetes.io/projected/97d3361d-b23a-48b3-9fde-543c07dc4fe2-kube-api-access-6tnlp\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.605478 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.605459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/97d3361d-b23a-48b3-9fde-543c07dc4fe2-redirect-config\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.619936 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.619916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tnlp\" (UniqueName: \"kubernetes.io/projected/97d3361d-b23a-48b3-9fde-543c07dc4fe2-kube-api-access-6tnlp\") pod \"dashboard-redirect-7df97bdc96-mjc6n\" (UID: \"97d3361d-b23a-48b3-9fde-543c07dc4fe2\") " pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.773860 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.773810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" Jun 10 17:13:10.900390 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:10.900365 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7df97bdc96-mjc6n"] Jun 10 17:13:10.902390 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:13:10.902362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d3361d_b23a_48b3_9fde_543c07dc4fe2.slice/crio-f49ca9a0bf745a1b834eb43ca2cab94888e6e9697157ad70cec6177935eabfe7 WatchSource:0}: Error finding container f49ca9a0bf745a1b834eb43ca2cab94888e6e9697157ad70cec6177935eabfe7: Status 404 returned error can't find the container with id f49ca9a0bf745a1b834eb43ca2cab94888e6e9697157ad70cec6177935eabfe7 Jun 10 17:13:11.773097 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:11.773052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" event={"ID":"97d3361d-b23a-48b3-9fde-543c07dc4fe2","Type":"ContainerStarted","Data":"f49ca9a0bf745a1b834eb43ca2cab94888e6e9697157ad70cec6177935eabfe7"} Jun 10 17:13:15.792569 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:15.792536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" event={"ID":"97d3361d-b23a-48b3-9fde-543c07dc4fe2","Type":"ContainerStarted","Data":"b961829cdb9327666984a95cf642077dcf850fb6843b14414b58da3f9fd7933d"} Jun 10 17:13:15.813190 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:15.813144 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7df97bdc96-mjc6n" podStartSLOduration=1.4717799280000001 podStartE2EDuration="5.813128093s" totalImagesPullingTime="4.341348165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:13:15.812299361 +0000 UTC m=+376.960846477" watchObservedRunningTime="2026-06-10 17:13:15.813128093 +0000 UTC m=+376.961675209" Jun 10 17:13:18.424485 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:18.424427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:18.529818 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:18.529789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:24.052013 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.051964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:24.069292 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.069258 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g"] Jun 10 17:13:24.074820 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.074801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.078077 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078056 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 17:13:24.078218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078077 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 17:13:24.078218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078080 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4czq7\"" Jun 10 17:13:24.078218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078150 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 17:13:24.078218 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078092 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 17:13:24.078436 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 17:13:24.078959 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.078945 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 17:13:24.083858 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.083840 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g"] Jun 10 17:13:24.111531 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5jhg\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-kube-api-access-g5jhg\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.111783 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.111767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.152815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.152793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:24.212589 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212693 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5jhg\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-kube-api-access-g5jhg\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212693 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212778 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212778 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212778 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.212923 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.212784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.213396 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.213365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.214966 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.214944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.215104 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.215090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.215205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.215189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.215292 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.215272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.221534 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.221515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.221941 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.221925 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5jhg\" (UniqueName: \"kubernetes.io/projected/015d5f2f-4ad7-4bbe-8485-8d87a99d2663-kube-api-access-g5jhg\") pod \"istiod-openshift-gateway-75c67f8887-vkg8g\" (UID: \"015d5f2f-4ad7-4bbe-8485-8d87a99d2663\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.385057 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.385002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:24.516990 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.516868 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g"] Jun 10 17:13:24.519846 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:13:24.519822 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015d5f2f_4ad7_4bbe_8485_8d87a99d2663.slice/crio-b39d1799591d95510140fa297040f1a1111b22b289e3513caf6b838e136ca470 WatchSource:0}: Error finding container b39d1799591d95510140fa297040f1a1111b22b289e3513caf6b838e136ca470: Status 404 returned error can't find the container with id b39d1799591d95510140fa297040f1a1111b22b289e3513caf6b838e136ca470 Jun 10 17:13:24.613720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.613693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:24.834047 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:24.834022 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" event={"ID":"015d5f2f-4ad7-4bbe-8485-8d87a99d2663","Type":"ContainerStarted","Data":"b39d1799591d95510140fa297040f1a1111b22b289e3513caf6b838e136ca470"} Jun 10 17:13:27.005875 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.005837 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 17:13:27.006275 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.005944 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 17:13:27.444970 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.444929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:27.545290 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.545246 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:27.735308 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.735224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:27.848124 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.848086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" event={"ID":"015d5f2f-4ad7-4bbe-8485-8d87a99d2663","Type":"ContainerStarted","Data":"d7db17a77a80ad783066b56316a27e92567353a15c1d66fe6338b22e96d11438"} Jun 10 17:13:27.848301 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.848220 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:27.871062 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.871008 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" podStartSLOduration=1.38751829 podStartE2EDuration="3.870990083s" totalImagesPullingTime="2.483471793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:13:27.870451966 +0000 UTC m=+389.018999083" watchObservedRunningTime="2026-06-10 17:13:27.870990083 +0000 UTC m=+389.019537203" Jun 10 17:13:27.880886 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.880846 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:27.978216 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:27.978185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:28.720164 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:28.720130 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z2b9s" Jun 10 17:13:28.853723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:28.853697 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-vkg8g" Jun 10 17:13:29.716639 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:29.716605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:44.265194 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:44.265163 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:44.356620 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:44.356592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:44.451081 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:44.451054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:54.694782 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:54.694743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:54.771216 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:54.771190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:56.943685 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:56.943633 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:13:57.000263 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:13:57.000240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:07.508337 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:07.508306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:08.072940 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:08.072909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:09.381578 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:09.381547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:09.473675 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:09.473630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:12.280442 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:12.280417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:15.793864 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:15.793832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:16.717683 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:16.717632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:18.478950 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:18.478916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:19.320486 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:19.320452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:22.232688 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.232642 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m"] Jun 10 17:14:22.236238 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.236218 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.239232 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.239205 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 17:14:22.239489 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.239255 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 17:14:22.239489 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.239338 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nspfm\"" Jun 10 17:14:22.253081 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.253058 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m"] Jun 10 17:14:22.270478 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.270451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.270478 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.270476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5xdt\" (UniqueName: \"kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.351245 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.351218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:22.370959 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.370932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.371068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.370966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5xdt\" (UniqueName: \"kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.371336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.371317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.386050 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.386031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5xdt\" (UniqueName: \"kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.545958 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.545885 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:22.678890 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:22.678869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m"] Jun 10 17:14:22.681773 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:14:22.681737 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda171de10_03f8_4be8_9a42_2286d0b14322.slice/crio-c3cd42f99836e2c56cfd49b7248cc10523f03e6838a1d33c8193cd82dbdd5962 WatchSource:0}: Error finding container c3cd42f99836e2c56cfd49b7248cc10523f03e6838a1d33c8193cd82dbdd5962: Status 404 returned error can't find the container with id c3cd42f99836e2c56cfd49b7248cc10523f03e6838a1d33c8193cd82dbdd5962 Jun 10 17:14:23.072446 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:23.072418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" event={"ID":"a171de10-03f8-4be8-9a42-2286d0b14322","Type":"ContainerStarted","Data":"c3cd42f99836e2c56cfd49b7248cc10523f03e6838a1d33c8193cd82dbdd5962"} Jun 10 17:14:23.701054 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:23.701021 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:23.801867 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:23.801812 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:24.087291 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:24.087151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:24.194837 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:24.194806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:27.885701 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:27.885628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:27.986070 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:27.986038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:30.700432 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:30.700393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:30.812274 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:30.812230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:31.111452 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:31.111422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" event={"ID":"a171de10-03f8-4be8-9a42-2286d0b14322","Type":"ContainerStarted","Data":"f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657"} Jun 10 17:14:31.111604 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:31.111543 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:31.138829 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:31.138785 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" podStartSLOduration=0.900325701 podStartE2EDuration="9.138771128s" totalImagesPullingTime="8.238445427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:14:31.138289048 +0000 UTC m=+452.286836195" watchObservedRunningTime="2026-06-10 17:14:31.138771128 +0000 UTC m=+452.287318243" Jun 10 17:14:33.589959 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:33.589922 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:33.699267 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:33.699235 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:33.790140 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:33.790108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:33.907714 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:33.907621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:33.991213 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:33.991182 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:34.175832 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:34.175801 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:34.675692 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:34.675666 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:34.739885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:34.739868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:35.100731 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:35.100638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:35.185482 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:35.185452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:35.981048 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:35.981011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:36.050293 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:36.050265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:42.118711 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:42.118683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:43.858319 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.858286 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m"] Jun 10 17:14:43.858724 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.858454 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" containerName="manager" containerID="cri-o://f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657" gracePeriod=2 Jun 10 17:14:43.876770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.876743 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m"] Jun 10 17:14:43.882332 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:43.882297 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a171de10-03f8-4be8-9a42-2286d0b14322\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ns95m\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:43.889536 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.889505 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:14:43.889910 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.889894 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" containerName="manager" Jun 10 17:14:43.889989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.889913 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" containerName="manager" Jun 10 17:14:43.890056 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.890042 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" containerName="manager" Jun 10 17:14:43.892754 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.892735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:43.906305 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.906277 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:14:43.925737 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.925716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:43.925845 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:43.925766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvgqx\" (UniqueName: \"kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:43.933198 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:43.933162 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" is forbidden: User \"system:node:ip-10-0-141-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-107.ec2.internal' and this object" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.027049 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.027023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:44.027149 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.027094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvgqx\" (UniqueName: \"kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:44.027422 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.027402 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:44.037070 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.037044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvgqx\" (UniqueName: \"kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tzdw2\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:44.091392 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.091369 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.093864 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:44.093842 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" is forbidden: User \"system:node:ip-10-0-141-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-107.ec2.internal' and this object" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.128257 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.128211 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5xdt\" (UniqueName: \"kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt\") pod \"a171de10-03f8-4be8-9a42-2286d0b14322\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " Jun 10 17:14:44.128337 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.128286 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume\") pod \"a171de10-03f8-4be8-9a42-2286d0b14322\" (UID: \"a171de10-03f8-4be8-9a42-2286d0b14322\") " Jun 10 17:14:44.128748 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.128725 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a171de10-03f8-4be8-9a42-2286d0b14322" (UID: "a171de10-03f8-4be8-9a42-2286d0b14322"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:14:44.130154 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.130135 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt" (OuterVolumeSpecName: "kube-api-access-c5xdt") pod "a171de10-03f8-4be8-9a42-2286d0b14322" (UID: "a171de10-03f8-4be8-9a42-2286d0b14322"). InnerVolumeSpecName "kube-api-access-c5xdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:14:44.173113 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.173090 2559 generic.go:356] "Generic (PLEG): container finished" podID="a171de10-03f8-4be8-9a42-2286d0b14322" containerID="f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657" exitCode=0 Jun 10 17:14:44.173194 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.173132 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.173194 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.173187 2559 scope.go:117] "RemoveContainer" containerID="f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657" Jun 10 17:14:44.175739 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:44.175707 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" is forbidden: User \"system:node:ip-10-0-141-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-107.ec2.internal' and this object" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.182157 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.182137 2559 scope.go:117] "RemoveContainer" containerID="f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657" Jun 10 17:14:44.182385 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:44.182368 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657\": container with ID starting with f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657 not found: ID does not exist" containerID="f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657" Jun 10 17:14:44.182441 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.182398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657"} err="failed to get container status \"f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657\": rpc error: code = NotFound desc = could not find container \"f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657\": container with ID starting with f2ca77f8bf0aeb07d4ed2822c70469f2bafead6e275840d6d21a3c6777f02657 not found: ID does not exist" Jun 10 17:14:44.183942 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:44.183921 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" is forbidden: User \"system:node:ip-10-0-141-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-107.ec2.internal' and this object" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:44.229456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.229420 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5xdt\" (UniqueName: \"kubernetes.io/projected/a171de10-03f8-4be8-9a42-2286d0b14322-kube-api-access-c5xdt\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:14:44.229456 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.229457 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a171de10-03f8-4be8-9a42-2286d0b14322-extensions-socket-volume\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:14:44.256308 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.256286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:44.324050 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.324022 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:44.395909 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.395878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:14:44.398219 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:14:44.398195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf102dc2_8bd4_4dbc_892e_e0674e023d19.slice/crio-0146cbb0d2fddf64e38a6800bf531794736d4950f12fec5076db4824380eccd9 WatchSource:0}: Error finding container 0146cbb0d2fddf64e38a6800bf531794736d4950f12fec5076db4824380eccd9: Status 404 returned error can't find the container with id 0146cbb0d2fddf64e38a6800bf531794736d4950f12fec5076db4824380eccd9 Jun 10 17:14:44.407611 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.407590 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:44.546095 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.546019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:44.651502 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.651414 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:44.901626 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:44.901542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:45.000147 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.000117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:45.180016 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.179982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" event={"ID":"df102dc2-8bd4-4dbc-892e-e0674e023d19","Type":"ContainerStarted","Data":"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7"} Jun 10 17:14:45.180188 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.180080 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" event={"ID":"df102dc2-8bd4-4dbc-892e-e0674e023d19","Type":"ContainerStarted","Data":"0146cbb0d2fddf64e38a6800bf531794736d4950f12fec5076db4824380eccd9"} Jun 10 17:14:45.180188 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.180115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:45.182687 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:14:45.182640 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ns95m\" is forbidden: User \"system:node:ip-10-0-141-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-107.ec2.internal' and this object" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns95m" Jun 10 17:14:45.208547 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.208504 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" podStartSLOduration=2.208490136 podStartE2EDuration="2.208490136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:14:45.206835163 +0000 UTC m=+466.355382281" watchObservedRunningTime="2026-06-10 17:14:45.208490136 +0000 UTC m=+466.357037253" Jun 10 17:14:45.300799 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:45.300776 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a171de10-03f8-4be8-9a42-2286d0b14322" path="/var/lib/kubelet/pods/a171de10-03f8-4be8-9a42-2286d0b14322/volumes" Jun 10 17:14:47.327365 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:47.327331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:48.689445 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:48.689413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:48.789970 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:48.789942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:50.382345 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:50.382309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:51.681591 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:51.681529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:51.782270 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:51.782239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:56.187088 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:56.187058 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:14:56.500915 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:56.500841 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:56.602837 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:56.602797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:14:59.270043 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:14:59.270010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:00.257736 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.257702 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:15:00.257926 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.257903 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" podUID="df102dc2-8bd4-4dbc-892e-e0674e023d19" containerName="manager" containerID="cri-o://bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7" gracePeriod=10 Jun 10 17:15:00.488757 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.488735 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:15:00.554811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.554716 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj"] Jun 10 17:15:00.555059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.555043 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df102dc2-8bd4-4dbc-892e-e0674e023d19" containerName="manager" Jun 10 17:15:00.555059 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.555058 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df102dc2-8bd4-4dbc-892e-e0674e023d19" containerName="manager" Jun 10 17:15:00.555194 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.555127 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df102dc2-8bd4-4dbc-892e-e0674e023d19" containerName="manager" Jun 10 17:15:00.557415 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.557397 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.562691 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.562671 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvgqx\" (UniqueName: \"kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx\") pod \"df102dc2-8bd4-4dbc-892e-e0674e023d19\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " Jun 10 17:15:00.562795 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.562735 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume\") pod \"df102dc2-8bd4-4dbc-892e-e0674e023d19\" (UID: \"df102dc2-8bd4-4dbc-892e-e0674e023d19\") " Jun 10 17:15:00.563086 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.563060 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df102dc2-8bd4-4dbc-892e-e0674e023d19" (UID: "df102dc2-8bd4-4dbc-892e-e0674e023d19"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:15:00.564927 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.564900 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx" (OuterVolumeSpecName: "kube-api-access-dvgqx") pod "df102dc2-8bd4-4dbc-892e-e0674e023d19" (UID: "df102dc2-8bd4-4dbc-892e-e0674e023d19"). InnerVolumeSpecName "kube-api-access-dvgqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:15:00.570501 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.570476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj"] Jun 10 17:15:00.664368 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.664332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be035d-4e6c-43f0-af1e-c579cd676a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.664562 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.664377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnx6\" (UniqueName: \"kubernetes.io/projected/f9be035d-4e6c-43f0-af1e-c579cd676a23-kube-api-access-4cnx6\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.664562 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.664456 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvgqx\" (UniqueName: \"kubernetes.io/projected/df102dc2-8bd4-4dbc-892e-e0674e023d19-kube-api-access-dvgqx\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:15:00.664562 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.664478 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df102dc2-8bd4-4dbc-892e-e0674e023d19-extensions-socket-volume\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:15:00.765132 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.765102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be035d-4e6c-43f0-af1e-c579cd676a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.765265 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.765145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnx6\" (UniqueName: \"kubernetes.io/projected/f9be035d-4e6c-43f0-af1e-c579cd676a23-kube-api-access-4cnx6\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.765483 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.765463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be035d-4e6c-43f0-af1e-c579cd676a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.775493 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.775470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnx6\" (UniqueName: \"kubernetes.io/projected/f9be035d-4e6c-43f0-af1e-c579cd676a23-kube-api-access-4cnx6\") pod \"kuadrant-operator-controller-manager-86878c769f-929fj\" (UID: \"f9be035d-4e6c-43f0-af1e-c579cd676a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:00.867232 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:00.867142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:01.007912 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.007878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj"] Jun 10 17:15:01.011327 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:15:01.011304 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9be035d_4e6c_43f0_af1e_c579cd676a23.slice/crio-99f2303c6c675070937e17283b99308acfced8131e35fc206336f9809e5ba415 WatchSource:0}: Error finding container 99f2303c6c675070937e17283b99308acfced8131e35fc206336f9809e5ba415: Status 404 returned error can't find the container with id 99f2303c6c675070937e17283b99308acfced8131e35fc206336f9809e5ba415 Jun 10 17:15:01.250989 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.250952 2559 generic.go:356] "Generic (PLEG): container finished" podID="df102dc2-8bd4-4dbc-892e-e0674e023d19" containerID="bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7" exitCode=0 Jun 10 17:15:01.251146 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.251009 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" Jun 10 17:15:01.251146 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.251044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" event={"ID":"df102dc2-8bd4-4dbc-892e-e0674e023d19","Type":"ContainerDied","Data":"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7"} Jun 10 17:15:01.251146 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.251121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2" event={"ID":"df102dc2-8bd4-4dbc-892e-e0674e023d19","Type":"ContainerDied","Data":"0146cbb0d2fddf64e38a6800bf531794736d4950f12fec5076db4824380eccd9"} Jun 10 17:15:01.251376 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.251154 2559 scope.go:117] "RemoveContainer" containerID="bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7" Jun 10 17:15:01.253406 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.253378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" event={"ID":"f9be035d-4e6c-43f0-af1e-c579cd676a23","Type":"ContainerStarted","Data":"8a43d0e5c1bceff769fbe53e4077fbc5d4151932e73548f26647a5425261c9f2"} Jun 10 17:15:01.253547 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.253425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" event={"ID":"f9be035d-4e6c-43f0-af1e-c579cd676a23","Type":"ContainerStarted","Data":"99f2303c6c675070937e17283b99308acfced8131e35fc206336f9809e5ba415"} Jun 10 17:15:01.253547 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.253521 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:01.260419 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.260398 2559 scope.go:117] "RemoveContainer" containerID="bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7" Jun 10 17:15:01.260698 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:15:01.260674 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7\": container with ID starting with bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7 not found: ID does not exist" containerID="bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7" Jun 10 17:15:01.260777 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.260707 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7"} err="failed to get container status \"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7\": rpc error: code = NotFound desc = could not find container \"bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7\": container with ID starting with bde2faa9068fc905cf5d80a3771f135cfedcf79b87539abac87c7a16529050e7 not found: ID does not exist" Jun 10 17:15:01.279479 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.279438 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" podStartSLOduration=1.279425434 podStartE2EDuration="1.279425434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:15:01.277737464 +0000 UTC m=+482.426284579" watchObservedRunningTime="2026-06-10 17:15:01.279425434 +0000 UTC m=+482.427972550" Jun 10 17:15:01.294082 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.294057 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:15:01.303470 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:01.303439 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tzdw2"] Jun 10 17:15:03.300954 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:03.300925 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df102dc2-8bd4-4dbc-892e-e0674e023d19" path="/var/lib/kubelet/pods/df102dc2-8bd4-4dbc-892e-e0674e023d19/volumes" Jun 10 17:15:12.260644 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:12.260611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-929fj" Jun 10 17:15:16.686787 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:16.686757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:16.791291 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:16.791254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:28.850587 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:28.850551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:28.959435 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:28.959407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:29.047264 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:29.047231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:29.738183 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:29.738139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:29.838873 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:29.838846 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:15:49.912977 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:15:49.912893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:02.159403 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:02.159364 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:02.536369 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:02.536332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:02.635227 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:02.635197 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:02.782762 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:02.782724 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:26.545530 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:26.545497 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:27.793184 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:27.793151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:59.093028 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:59.092990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:16:59.281453 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:59.281425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:16:59.281802 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:59.281782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:16:59.302599 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:16:59.302573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:05.201008 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.200974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:05.213307 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.213281 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:05.216880 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.216862 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.219770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.219752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 17:17:05.219955 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.219938 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lgsnc\"" Jun 10 17:17:05.220030 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.219943 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 17:17:05.236321 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.236297 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:05.301297 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.301269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:05.371835 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.371810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvxm\" (UniqueName: \"kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.371995 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.371971 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.400475 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.400450 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-868d9989b5-gpxz6"] Jun 10 17:17:05.402945 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.402925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:05.403776 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.403761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.415576 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.415555 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-868d9989b5-gpxz6"] Jun 10 17:17:05.469702 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.469620 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:05.472778 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.472759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvxm\" (UniqueName: \"kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.472849 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.472803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.475209 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.475181 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.482068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.482043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvxm\" (UniqueName: \"kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm\") pod \"maas-controller-dc9c6958-rc5wb\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.529473 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.529454 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:05.574346 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.574319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/371a625f-0ae0-4f3a-af7a-81ef5f277b58-webhook-cert\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.574483 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.574357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6q8\" (UniqueName: \"kubernetes.io/projected/371a625f-0ae0-4f3a-af7a-81ef5f277b58-kube-api-access-rz6q8\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.659612 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.659583 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:05.664290 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:17:05.664261 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12030bc_32b8_42f0_b454_689a99a132d9.slice/crio-3d69349eb2655d96c27a98e1286e5c9008f6117e9e32eac71d609472a4f20926 WatchSource:0}: Error finding container 3d69349eb2655d96c27a98e1286e5c9008f6117e9e32eac71d609472a4f20926: Status 404 returned error can't find the container with id 3d69349eb2655d96c27a98e1286e5c9008f6117e9e32eac71d609472a4f20926 Jun 10 17:17:05.675330 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.675301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/371a625f-0ae0-4f3a-af7a-81ef5f277b58-webhook-cert\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.675428 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.675337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6q8\" (UniqueName: \"kubernetes.io/projected/371a625f-0ae0-4f3a-af7a-81ef5f277b58-kube-api-access-rz6q8\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.677530 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.677510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/371a625f-0ae0-4f3a-af7a-81ef5f277b58-webhook-cert\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.684593 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.684576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6q8\" (UniqueName: \"kubernetes.io/projected/371a625f-0ae0-4f3a-af7a-81ef5f277b58-kube-api-access-rz6q8\") pod \"maas-controller-868d9989b5-gpxz6\" (UID: \"371a625f-0ae0-4f3a-af7a-81ef5f277b58\") " pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.713628 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.713594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:05.775010 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.774977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc9c6958-rc5wb" event={"ID":"c12030bc-32b8-42f0-b454-689a99a132d9","Type":"ContainerStarted","Data":"3d69349eb2655d96c27a98e1286e5c9008f6117e9e32eac71d609472a4f20926"} Jun 10 17:17:05.844732 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:05.844707 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-868d9989b5-gpxz6"] Jun 10 17:17:05.845043 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:17:05.845018 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371a625f_0ae0_4f3a_af7a_81ef5f277b58.slice/crio-84842672319fd7f5a4c7a0d8f1d6b5bb6786363e108278976fdc3c0bd283016f WatchSource:0}: Error finding container 84842672319fd7f5a4c7a0d8f1d6b5bb6786363e108278976fdc3c0bd283016f: Status 404 returned error can't find the container with id 84842672319fd7f5a4c7a0d8f1d6b5bb6786363e108278976fdc3c0bd283016f Jun 10 17:17:06.783620 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:06.783541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-868d9989b5-gpxz6" event={"ID":"371a625f-0ae0-4f3a-af7a-81ef5f277b58","Type":"ContainerStarted","Data":"84842672319fd7f5a4c7a0d8f1d6b5bb6786363e108278976fdc3c0bd283016f"} Jun 10 17:17:08.469491 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.469457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:08.569251 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.569156 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:08.794379 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.794335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc9c6958-rc5wb" event={"ID":"c12030bc-32b8-42f0-b454-689a99a132d9","Type":"ContainerStarted","Data":"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75"} Jun 10 17:17:08.794559 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.794499 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:08.795764 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.795744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-868d9989b5-gpxz6" event={"ID":"371a625f-0ae0-4f3a-af7a-81ef5f277b58","Type":"ContainerStarted","Data":"f96dbad60915b49d5e6e4369fc5519fc25481e8e52c968c2b0d7c7d09b990036"} Jun 10 17:17:08.795878 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.795865 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:08.819572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.819490 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dc9c6958-rc5wb" podStartSLOduration=1.197121142 podStartE2EDuration="3.819478267s" totalImagesPullingTime="2.622357125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:17:08.817232719 +0000 UTC m=+609.965779832" watchObservedRunningTime="2026-06-10 17:17:08.819478267 +0000 UTC m=+609.968025382" Jun 10 17:17:08.838640 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:08.838598 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-868d9989b5-gpxz6" podStartSLOduration=1.390352761 podStartE2EDuration="3.838586062s" totalImagesPullingTime="2.448233301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:17:08.837745016 +0000 UTC m=+609.986292133" watchObservedRunningTime="2026-06-10 17:17:08.838586062 +0000 UTC m=+609.987133178" Jun 10 17:17:19.806485 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:19.806406 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-868d9989b5-gpxz6" Jun 10 17:17:19.806485 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:19.806472 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:19.876388 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:19.876351 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:19.876578 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:19.876532 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-dc9c6958-rc5wb" podUID="c12030bc-32b8-42f0-b454-689a99a132d9" containerName="manager" containerID="cri-o://3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75" gracePeriod=30 Jun 10 17:17:20.119307 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.119279 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:20.190290 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.190266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvvxm\" (UniqueName: \"kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm\") pod \"c12030bc-32b8-42f0-b454-689a99a132d9\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " Jun 10 17:17:20.190426 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.190315 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert\") pod \"c12030bc-32b8-42f0-b454-689a99a132d9\" (UID: \"c12030bc-32b8-42f0-b454-689a99a132d9\") " Jun 10 17:17:20.192205 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.192176 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm" (OuterVolumeSpecName: "kube-api-access-jvvxm") pod "c12030bc-32b8-42f0-b454-689a99a132d9" (UID: "c12030bc-32b8-42f0-b454-689a99a132d9"). InnerVolumeSpecName "kube-api-access-jvvxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:17:20.192309 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.192265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c12030bc-32b8-42f0-b454-689a99a132d9" (UID: "c12030bc-32b8-42f0-b454-689a99a132d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:17:20.290833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.290804 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12030bc-32b8-42f0-b454-689a99a132d9-webhook-cert\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:17:20.290833 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.290830 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvvxm\" (UniqueName: \"kubernetes.io/projected/c12030bc-32b8-42f0-b454-689a99a132d9-kube-api-access-jvvxm\") on node \"ip-10-0-141-107.ec2.internal\" DevicePath \"\"" Jun 10 17:17:20.849091 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.849059 2559 generic.go:356] "Generic (PLEG): container finished" podID="c12030bc-32b8-42f0-b454-689a99a132d9" containerID="3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75" exitCode=0 Jun 10 17:17:20.849492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.849103 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc9c6958-rc5wb" Jun 10 17:17:20.849492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.849118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc9c6958-rc5wb" event={"ID":"c12030bc-32b8-42f0-b454-689a99a132d9","Type":"ContainerDied","Data":"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75"} Jun 10 17:17:20.849492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.849158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc9c6958-rc5wb" event={"ID":"c12030bc-32b8-42f0-b454-689a99a132d9","Type":"ContainerDied","Data":"3d69349eb2655d96c27a98e1286e5c9008f6117e9e32eac71d609472a4f20926"} Jun 10 17:17:20.849492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.849180 2559 scope.go:117] "RemoveContainer" containerID="3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75" Jun 10 17:17:20.858421 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.858406 2559 scope.go:117] "RemoveContainer" containerID="3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75" Jun 10 17:17:20.858690 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:17:20.858671 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75\": container with ID starting with 3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75 not found: ID does not exist" containerID="3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75" Jun 10 17:17:20.858761 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.858702 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75"} err="failed to get container status \"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75\": rpc error: code = NotFound desc = could not find container \"3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75\": container with ID starting with 3845ae25d75a8c7360a9f65574dddefb97c5bcbd72d69b0d300dc8575df15b75 not found: ID does not exist" Jun 10 17:17:20.872092 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.872071 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:20.876106 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:20.876084 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dc9c6958-rc5wb"] Jun 10 17:17:21.302473 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:21.302442 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c12030bc-32b8-42f0-b454-689a99a132d9" path="/var/lib/kubelet/pods/c12030bc-32b8-42f0-b454-689a99a132d9/volumes" Jun 10 17:17:40.118443 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.118404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:40.153963 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.153937 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-65498bc788-rwpxb"] Jun 10 17:17:40.154267 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.154255 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c12030bc-32b8-42f0-b454-689a99a132d9" containerName="manager" Jun 10 17:17:40.154308 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.154268 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c12030bc-32b8-42f0-b454-689a99a132d9" containerName="manager" Jun 10 17:17:40.154345 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.154326 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c12030bc-32b8-42f0-b454-689a99a132d9" containerName="manager" Jun 10 17:17:40.158377 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.158361 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.160979 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.160961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 17:17:40.161150 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.160999 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7jb27\"" Jun 10 17:17:40.166841 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.166820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-65498bc788-rwpxb"] Jun 10 17:17:40.252084 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.252051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.252220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.252087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvvhv\" (UniqueName: \"kubernetes.io/projected/f7e9cdd5-e961-4e21-b842-d39aae673b5a-kube-api-access-vvvhv\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.252220 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.252166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7e9cdd5-e961-4e21-b842-d39aae673b5a-openshift-service-ca\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.353490 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.353466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.353634 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.353501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvvhv\" (UniqueName: \"kubernetes.io/projected/f7e9cdd5-e961-4e21-b842-d39aae673b5a-kube-api-access-vvvhv\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.353634 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.353574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7e9cdd5-e961-4e21-b842-d39aae673b5a-openshift-service-ca\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.353783 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:17:40.353628 2559 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 10 17:17:40.353783 ip-10-0-141-107 kubenswrapper[2559]: E0610 17:17:40.353715 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls podName:f7e9cdd5-e961-4e21-b842-d39aae673b5a nodeName:}" failed. No retries permitted until 2026-06-10 17:17:40.853694401 +0000 UTC m=+642.002241512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls") pod "maas-api-65498bc788-rwpxb" (UID: "f7e9cdd5-e961-4e21-b842-d39aae673b5a") : secret "maas-api-serving-cert" not found Jun 10 17:17:40.354213 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.354191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7e9cdd5-e961-4e21-b842-d39aae673b5a-openshift-service-ca\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.365560 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.365538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvvhv\" (UniqueName: \"kubernetes.io/projected/f7e9cdd5-e961-4e21-b842-d39aae673b5a-kube-api-access-vvvhv\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.411325 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.411260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:40.551855 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.551824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:40.650287 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.650253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:40.678061 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.678037 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-q8crc"] Jun 10 17:17:40.681440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.681424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:40.684196 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.684175 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 17:17:40.684299 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.684212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7d89v\"" Jun 10 17:17:40.686740 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.686715 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-frc7n"] Jun 10 17:17:40.689855 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.689831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:40.690381 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.690360 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-q8crc"] Jun 10 17:17:40.703705 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.703684 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-frc7n"] Jun 10 17:17:40.756576 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.756544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/5881f70d-2a9e-48f0-876d-3bee9b92f8e9-kube-api-access-8p8dn\") pod \"payload-pre-processing-579785bc64-q8crc\" (UID: \"5881f70d-2a9e-48f0-876d-3bee9b92f8e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:40.756723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.756594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5lw\" (UniqueName: \"kubernetes.io/projected/75237303-ce44-4f08-8a89-a8ed2e588cdd-kube-api-access-8x5lw\") pod \"payload-processing-699b6cd6c-frc7n\" (UID: \"75237303-ce44-4f08-8a89-a8ed2e588cdd\") " pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:40.857887 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.857856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/5881f70d-2a9e-48f0-876d-3bee9b92f8e9-kube-api-access-8p8dn\") pod \"payload-pre-processing-579785bc64-q8crc\" (UID: \"5881f70d-2a9e-48f0-876d-3bee9b92f8e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:40.858045 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.857901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5lw\" (UniqueName: \"kubernetes.io/projected/75237303-ce44-4f08-8a89-a8ed2e588cdd-kube-api-access-8x5lw\") pod \"payload-processing-699b6cd6c-frc7n\" (UID: \"75237303-ce44-4f08-8a89-a8ed2e588cdd\") " pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:40.858141 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.858126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.860473 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.860445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7e9cdd5-e961-4e21-b842-d39aae673b5a-maas-api-tls\") pod \"maas-api-65498bc788-rwpxb\" (UID: \"f7e9cdd5-e961-4e21-b842-d39aae673b5a\") " pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:40.867007 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.866980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5lw\" (UniqueName: \"kubernetes.io/projected/75237303-ce44-4f08-8a89-a8ed2e588cdd-kube-api-access-8x5lw\") pod \"payload-processing-699b6cd6c-frc7n\" (UID: \"75237303-ce44-4f08-8a89-a8ed2e588cdd\") " pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:40.867111 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.867093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/5881f70d-2a9e-48f0-876d-3bee9b92f8e9-kube-api-access-8p8dn\") pod \"payload-pre-processing-579785bc64-q8crc\" (UID: \"5881f70d-2a9e-48f0-876d-3bee9b92f8e9\") " pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:40.994523 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:40.994441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:41.002457 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.002429 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:41.070474 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.070404 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:41.144885 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.144811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-q8crc"] Jun 10 17:17:41.163015 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.162992 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:17:41.182389 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.182363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-frc7n"] Jun 10 17:17:41.184662 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:17:41.184618 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75237303_ce44_4f08_8a89_a8ed2e588cdd.slice/crio-0926fd2ec53ac00ebd42bb8f4e28e64f96a099bbd182e291b7f6c165bf3f44b0 WatchSource:0}: Error finding container 0926fd2ec53ac00ebd42bb8f4e28e64f96a099bbd182e291b7f6c165bf3f44b0: Status 404 returned error can't find the container with id 0926fd2ec53ac00ebd42bb8f4e28e64f96a099bbd182e291b7f6c165bf3f44b0 Jun 10 17:17:41.225618 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.225592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-65498bc788-rwpxb"] Jun 10 17:17:41.227809 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:17:41.227786 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e9cdd5_e961_4e21_b842_d39aae673b5a.slice/crio-aa0a4df6e5a6a5b8a707db60678cf75331fb3bc81abd6441c1aae298b50574a2 WatchSource:0}: Error finding container aa0a4df6e5a6a5b8a707db60678cf75331fb3bc81abd6441c1aae298b50574a2: Status 404 returned error can't find the container with id aa0a4df6e5a6a5b8a707db60678cf75331fb3bc81abd6441c1aae298b50574a2 Jun 10 17:17:41.942811 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.942719 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" event={"ID":"5881f70d-2a9e-48f0-876d-3bee9b92f8e9","Type":"ContainerStarted","Data":"fc5e11941f7bfa7c2cfa4293fbcb45713f9535ef47e9251fbed831bbfbb77f30"} Jun 10 17:17:41.944883 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.944832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-65498bc788-rwpxb" event={"ID":"f7e9cdd5-e961-4e21-b842-d39aae673b5a","Type":"ContainerStarted","Data":"aa0a4df6e5a6a5b8a707db60678cf75331fb3bc81abd6441c1aae298b50574a2"} Jun 10 17:17:41.947723 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:41.947693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" event={"ID":"75237303-ce44-4f08-8a89-a8ed2e588cdd","Type":"ContainerStarted","Data":"0926fd2ec53ac00ebd42bb8f4e28e64f96a099bbd182e291b7f6c165bf3f44b0"} Jun 10 17:17:44.964694 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.964646 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" event={"ID":"5881f70d-2a9e-48f0-876d-3bee9b92f8e9","Type":"ContainerStarted","Data":"3b89d84e04f8714602ac5c95327c08aeacad4cb85f98050598f8e1b413165e37"} Jun 10 17:17:44.965125 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.964752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:44.966181 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.966161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-65498bc788-rwpxb" event={"ID":"f7e9cdd5-e961-4e21-b842-d39aae673b5a","Type":"ContainerStarted","Data":"7f33faf12910ece159c93d247345423d1dcc0510013d72b3134c3b979dba309c"} Jun 10 17:17:44.966290 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.966253 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:44.967637 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.967615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" event={"ID":"75237303-ce44-4f08-8a89-a8ed2e588cdd","Type":"ContainerStarted","Data":"1ee1463cb85be521e82433e6a8972ed9214320a8ff91838fe5c299acfb64760b"} Jun 10 17:17:44.967782 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.967759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:44.995191 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:44.995142 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" podStartSLOduration=2.181103599 podStartE2EDuration="4.995124679s" totalImagesPullingTime="2.81402108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:17:44.993188378 +0000 UTC m=+646.141735498" watchObservedRunningTime="2026-06-10 17:17:44.995124679 +0000 UTC m=+646.143671796" Jun 10 17:17:45.060574 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:45.060532 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-65498bc788-rwpxb" podStartSLOduration=2.380147296 podStartE2EDuration="5.06051897s" totalImagesPullingTime="2.680371674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:17:45.059770871 +0000 UTC m=+646.208317988" watchObservedRunningTime="2026-06-10 17:17:45.06051897 +0000 UTC m=+646.209066085" Jun 10 17:17:45.061179 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:45.061152 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" podStartSLOduration=2.278443467 podStartE2EDuration="5.061145964s" totalImagesPullingTime="2.782702497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:17:45.024521705 +0000 UTC m=+646.173068828" watchObservedRunningTime="2026-06-10 17:17:45.061145964 +0000 UTC m=+646.209693080" Jun 10 17:17:47.329943 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:47.329908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:47.430858 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:47.430822 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:17:50.978282 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:50.978254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-65498bc788-rwpxb" Jun 10 17:17:55.974155 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:55.974115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-frc7n" Jun 10 17:17:55.974588 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:55.974350 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-q8crc" Jun 10 17:17:56.203695 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:17:56.203638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:18:07.205864 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:18:07.205826 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:19:33.535101 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:19:33.535070 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:20:35.354761 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:20:35.354611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:20:35.449292 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:20:35.449266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:20:40.306945 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:20:40.306910 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:20:46.871009 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:20:46.870973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:21:05.458469 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.458396 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2"] Jun 10 17:21:05.466164 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.465976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.468965 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.468932 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 17:21:05.470515 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.470490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 17:21:05.471169 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.470511 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gzglv\"" Jun 10 17:21:05.471425 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.470594 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 17:21:05.478071 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.478046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2"] Jun 10 17:21:05.480893 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.480867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:21:05.589536 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.589536 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rljd\" (UniqueName: \"kubernetes.io/projected/099cb233-1c46-4378-b69c-ae4688ce93c0-kube-api-access-7rljd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.589781 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/099cb233-1c46-4378-b69c-ae4688ce93c0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.589781 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.589781 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.589898 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.589794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691026 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.690986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rljd\" (UniqueName: \"kubernetes.io/projected/099cb233-1c46-4378-b69c-ae4688ce93c0-kube-api-access-7rljd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691221 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691213 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/099cb233-1c46-4378-b69c-ae4688ce93c0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691551 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.691664 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.691559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.693335 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.693313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/099cb233-1c46-4378-b69c-ae4688ce93c0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.693579 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.693562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/099cb233-1c46-4378-b69c-ae4688ce93c0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.701107 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.701081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rljd\" (UniqueName: \"kubernetes.io/projected/099cb233-1c46-4378-b69c-ae4688ce93c0-kube-api-access-7rljd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2\" (UID: \"099cb233-1c46-4378-b69c-ae4688ce93c0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.781822 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.781733 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:05.920990 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:05.920961 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2"] Jun 10 17:21:05.923022 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:21:05.922997 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099cb233_1c46_4378_b69c_ae4688ce93c0.slice/crio-ada2e2a36e5a0127586a6a2085ab78423c18112445c75bd68dd5ac309bf85960 WatchSource:0}: Error finding container ada2e2a36e5a0127586a6a2085ab78423c18112445c75bd68dd5ac309bf85960: Status 404 returned error can't find the container with id ada2e2a36e5a0127586a6a2085ab78423c18112445c75bd68dd5ac309bf85960 Jun 10 17:21:06.853803 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:06.853537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" event={"ID":"099cb233-1c46-4378-b69c-ae4688ce93c0","Type":"ContainerStarted","Data":"ada2e2a36e5a0127586a6a2085ab78423c18112445c75bd68dd5ac309bf85960"} Jun 10 17:21:10.875613 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:10.875569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" event={"ID":"099cb233-1c46-4378-b69c-ae4688ce93c0","Type":"ContainerStarted","Data":"993211490cbbcfd1c9536fa8c6706efa94da708b89dddb1c926f4ba7a8c7b570"} Jun 10 17:21:11.881755 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:11.881718 2559 generic.go:356] "Generic (PLEG): container finished" podID="099cb233-1c46-4378-b69c-ae4688ce93c0" containerID="993211490cbbcfd1c9536fa8c6706efa94da708b89dddb1c926f4ba7a8c7b570" exitCode=0 Jun 10 17:21:11.882254 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:11.881811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" event={"ID":"099cb233-1c46-4378-b69c-ae4688ce93c0","Type":"ContainerDied","Data":"993211490cbbcfd1c9536fa8c6706efa94da708b89dddb1c926f4ba7a8c7b570"} Jun 10 17:21:13.893136 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:13.893092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" event={"ID":"099cb233-1c46-4378-b69c-ae4688ce93c0","Type":"ContainerStarted","Data":"e5af2cc98e0dd32ba9cc5998f2f2a9099680e0ea5592cb83c990198275b33318"} Jun 10 17:21:13.916492 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:13.916441 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" podStartSLOduration=2.370219668 podStartE2EDuration="8.916426341s" totalImagesPullingTime="5.025880141s" totalInitContainerRuntime="1.520326532s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:21:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:21:13.914466288 +0000 UTC m=+855.063013444" watchObservedRunningTime="2026-06-10 17:21:13.916426341 +0000 UTC m=+855.064973457" Jun 10 17:21:15.782879 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:15.782848 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:15.783244 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:15.782913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:15.795338 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:15.795317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:15.912815 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:15.912793 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2" Jun 10 17:21:18.296399 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:18.296361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:21:28.149947 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.149908 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr"] Jun 10 17:21:28.164592 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.164562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.165102 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.165079 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr"] Jun 10 17:21:28.167499 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.167480 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 17:21:28.180004 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.179957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:21:28.296802 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.296974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbn5v\" (UniqueName: \"kubernetes.io/projected/545feeb4-ee1c-45b5-b7df-045ee8172a59-kube-api-access-pbn5v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.296974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.296974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.296974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.296974 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.296963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545feeb4-ee1c-45b5-b7df-045ee8172a59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398151 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbn5v\" (UniqueName: \"kubernetes.io/projected/545feeb4-ee1c-45b5-b7df-045ee8172a59-kube-api-access-pbn5v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545feeb4-ee1c-45b5-b7df-045ee8172a59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398523 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398674 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398780 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.398835 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.398778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.400612 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.400551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545feeb4-ee1c-45b5-b7df-045ee8172a59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.400743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.400715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545feeb4-ee1c-45b5-b7df-045ee8172a59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.407742 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.407722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbn5v\" (UniqueName: \"kubernetes.io/projected/545feeb4-ee1c-45b5-b7df-045ee8172a59-kube-api-access-pbn5v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr\" (UID: \"545feeb4-ee1c-45b5-b7df-045ee8172a59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.476499 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.476459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:28.617689 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.617642 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr"] Jun 10 17:21:28.619041 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:21:28.619010 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545feeb4_ee1c_45b5_b7df_045ee8172a59.slice/crio-1d7b78cc8ab2eb8eb8ad602fb12fc430e7fb2d5fc33ac3adf083301e8540b6e5 WatchSource:0}: Error finding container 1d7b78cc8ab2eb8eb8ad602fb12fc430e7fb2d5fc33ac3adf083301e8540b6e5: Status 404 returned error can't find the container with id 1d7b78cc8ab2eb8eb8ad602fb12fc430e7fb2d5fc33ac3adf083301e8540b6e5 Jun 10 17:21:28.963710 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.963667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" event={"ID":"545feeb4-ee1c-45b5-b7df-045ee8172a59","Type":"ContainerStarted","Data":"5c759b543a3ced5e9e3f7f81c887ccc24f850b85e8c20ee84ccef09fe6cca63c"} Jun 10 17:21:28.963908 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:28.963737 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" event={"ID":"545feeb4-ee1c-45b5-b7df-045ee8172a59","Type":"ContainerStarted","Data":"1d7b78cc8ab2eb8eb8ad602fb12fc430e7fb2d5fc33ac3adf083301e8540b6e5"} Jun 10 17:21:30.974497 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:30.974464 2559 generic.go:356] "Generic (PLEG): container finished" podID="545feeb4-ee1c-45b5-b7df-045ee8172a59" containerID="5c759b543a3ced5e9e3f7f81c887ccc24f850b85e8c20ee84ccef09fe6cca63c" exitCode=0 Jun 10 17:21:30.974897 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:30.974546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" event={"ID":"545feeb4-ee1c-45b5-b7df-045ee8172a59","Type":"ContainerDied","Data":"5c759b543a3ced5e9e3f7f81c887ccc24f850b85e8c20ee84ccef09fe6cca63c"} Jun 10 17:21:31.980610 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:31.980575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" event={"ID":"545feeb4-ee1c-45b5-b7df-045ee8172a59","Type":"ContainerStarted","Data":"4ecaf4526fc95672cd4f8cf4c53d0bc9ee3fee2b132b8da1a3527850f06320d9"} Jun 10 17:21:32.001844 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:32.001790 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" podStartSLOduration=2.318931115 podStartE2EDuration="4.001775139s" totalImagesPullingTime="363.220229ms" totalInitContainerRuntime="1.319623795s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:21:32.000702871 +0000 UTC m=+873.149250020" watchObservedRunningTime="2026-06-10 17:21:32.001775139 +0000 UTC m=+873.150322301" Jun 10 17:21:38.477632 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:38.477586 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:38.478311 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:38.477671 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:38.489609 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:38.489588 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:39.022457 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:39.022428 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr" Jun 10 17:21:49.268522 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.268448 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4"] Jun 10 17:21:49.272336 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.272317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.275270 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.275174 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 17:21:49.284370 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.284340 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4"] Jun 10 17:21:49.320123 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.320093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:21:49.362200 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.362314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.362314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.362314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.362440 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lp87\" (UniqueName: \"kubernetes.io/projected/377e24a0-4767-4cf3-b505-9345e42e8acc-kube-api-access-7lp87\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.362477 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.362434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/377e24a0-4767-4cf3-b505-9345e42e8acc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463290 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463290 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463500 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463500 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463596 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lp87\" (UniqueName: \"kubernetes.io/projected/377e24a0-4767-4cf3-b505-9345e42e8acc-kube-api-access-7lp87\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463596 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/377e24a0-4767-4cf3-b505-9345e42e8acc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463674 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463743 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.463880 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.463861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.465799 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.465771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/377e24a0-4767-4cf3-b505-9345e42e8acc-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.465969 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.465952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/377e24a0-4767-4cf3-b505-9345e42e8acc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.473720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.473681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lp87\" (UniqueName: \"kubernetes.io/projected/377e24a0-4767-4cf3-b505-9345e42e8acc-kube-api-access-7lp87\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-stcn4\" (UID: \"377e24a0-4767-4cf3-b505-9345e42e8acc\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.600537 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.600443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:21:49.740664 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:49.740624 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4"] Jun 10 17:21:49.742540 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:21:49.742512 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377e24a0_4767_4cf3_b505_9345e42e8acc.slice/crio-8d6b1714c440e37a21f571c5deb3a4679f9f6b238388d3e06452151f6c7013c6 WatchSource:0}: Error finding container 8d6b1714c440e37a21f571c5deb3a4679f9f6b238388d3e06452151f6c7013c6: Status 404 returned error can't find the container with id 8d6b1714c440e37a21f571c5deb3a4679f9f6b238388d3e06452151f6c7013c6 Jun 10 17:21:50.060768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:50.060735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" event={"ID":"377e24a0-4767-4cf3-b505-9345e42e8acc","Type":"ContainerStarted","Data":"1880548c12bfb607c3f70b2431ab2fc1a0d2acf75ba58b8f845f7f045adabdb5"} Jun 10 17:21:50.060768 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:50.060776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" event={"ID":"377e24a0-4767-4cf3-b505-9345e42e8acc","Type":"ContainerStarted","Data":"8d6b1714c440e37a21f571c5deb3a4679f9f6b238388d3e06452151f6c7013c6"} Jun 10 17:21:59.316264 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:59.316234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:21:59.318877 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:21:59.318855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg7d4_bd80a0b4-d973-4825-a802-8a18a4e03d80/ovn-acl-logging/0.log" Jun 10 17:22:10.715281 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:22:10.715244 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:23:12.071523 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:12.071425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:23:34.533453 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:34.533424 2559 generic.go:356] "Generic (PLEG): container finished" podID="377e24a0-4767-4cf3-b505-9345e42e8acc" containerID="1880548c12bfb607c3f70b2431ab2fc1a0d2acf75ba58b8f845f7f045adabdb5" exitCode=0 Jun 10 17:23:34.533862 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:34.533472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" event={"ID":"377e24a0-4767-4cf3-b505-9345e42e8acc","Type":"ContainerDied","Data":"1880548c12bfb607c3f70b2431ab2fc1a0d2acf75ba58b8f845f7f045adabdb5"} Jun 10 17:23:34.534104 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:34.534087 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:23:35.540454 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:35.540423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" event={"ID":"377e24a0-4767-4cf3-b505-9345e42e8acc","Type":"ContainerStarted","Data":"5e251c2ca8791e704b1d2e5278ae4095ea6cef37d63bea186e44b4c39e4d50dc"} Jun 10 17:23:35.563532 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:35.563484 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" podStartSLOduration=1.769372629 podStartE2EDuration="1m46.563469481s" totalImagesPullingTime="301.98803ms" totalInitContainerRuntime="1m44.492108822s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:23:35.56207598 +0000 UTC m=+996.710623097" watchObservedRunningTime="2026-06-10 17:23:35.563469481 +0000 UTC m=+996.712016597" Jun 10 17:23:39.601139 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:39.601103 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:23:39.601572 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:39.601154 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:23:39.613909 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:39.613879 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:23:40.576666 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:40.576623 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-stcn4" Jun 10 17:23:42.726472 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:42.726440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:23:42.826172 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:42.826132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:23:43.855291 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:43.855251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:23:43.955227 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:23:43.955194 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:24:27.042813 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.042786 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7df97bdc96-mjc6n_97d3361d-b23a-48b3-9fde-543c07dc4fe2/nginx/0.log" Jun 10 17:24:27.297890 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.297806 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z2b9s_2d3c9461-1ca2-4562-a0ba-0c3ab2895759/manager/0.log" Jun 10 17:24:27.421119 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.421070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-65498bc788-rwpxb_f7e9cdd5-e961-4e21-b842-d39aae673b5a/maas-api/0.log" Jun 10 17:24:27.537770 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.537732 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-868d9989b5-gpxz6_371a625f-0ae0-4f3a-af7a-81ef5f277b58/manager/0.log" Jun 10 17:24:27.764107 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.764080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-b6d9c_ba64dce2-8fcd-4575-9a2f-a836d7b214ae/manager/0.log" Jun 10 17:24:27.878365 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.878343 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f955fdfd-k9r8q_9a32a1a6-2668-4285-bbc2-abfa3b83a9e1/copy-manifests/0.log" Jun 10 17:24:27.888114 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:27.888098 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f955fdfd-k9r8q_9a32a1a6-2668-4285-bbc2-abfa3b83a9e1/manager/0.log" Jun 10 17:24:30.122021 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:30.121990 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-929fj_f9be035d-4e6c-43f0-af1e-c579cd676a23/manager/0.log" Jun 10 17:24:30.841518 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:30.841491 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-vkg8g_015d5f2f-4ad7-4bbe-8485-8d87a99d2663/discovery/0.log" Jun 10 17:24:31.295967 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:31.295934 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-q8crc_5881f70d-2a9e-48f0-876d-3bee9b92f8e9/payload-pre-processing/0.log" Jun 10 17:24:31.408196 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:31.408168 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-frc7n_75237303-ce44-4f08-8a89-a8ed2e588cdd/payload-processing/0.log" Jun 10 17:24:32.126665 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.126612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2_099cb233-1c46-4378-b69c-ae4688ce93c0/storage-initializer/0.log" Jun 10 17:24:32.135202 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.135182 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4lvm2_099cb233-1c46-4378-b69c-ae4688ce93c0/main/0.log" Jun 10 17:24:32.394171 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.394095 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr_545feeb4-ee1c-45b5-b7df-045ee8172a59/storage-initializer/0.log" Jun 10 17:24:32.403375 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.403353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-p7lfr_545feeb4-ee1c-45b5-b7df-045ee8172a59/main/0.log" Jun 10 17:24:32.519524 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.519502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-stcn4_377e24a0-4767-4cf3-b505-9345e42e8acc/storage-initializer/0.log" Jun 10 17:24:32.531110 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:32.531091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-stcn4_377e24a0-4767-4cf3-b505-9345e42e8acc/main/0.log" Jun 10 17:24:36.656165 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:36.656135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:24:36.756314 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:36.756288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" limit=1024 Jun 10 17:24:39.797633 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:39.797547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s5b62_7c808093-3f6d-43df-9b92-b1930c61e98b/global-pull-secret-syncer/0.log" Jun 10 17:24:39.847235 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:39.847212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-22jfc_4255a57d-f3f7-45ee-8c24-ad9e930e7935/konnectivity-agent/0.log" Jun 10 17:24:39.957013 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:39.956991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-107.ec2.internal_148f933c9ee16c3446ec9479cab89d03/haproxy/0.log" Jun 10 17:24:45.278712 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:45.278620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-929fj_f9be035d-4e6c-43f0-af1e-c579cd676a23/manager/0.log" Jun 10 17:24:47.171301 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.171276 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/alertmanager/0.log" Jun 10 17:24:47.196353 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.196334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/config-reloader/0.log" Jun 10 17:24:47.228856 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.228797 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/kube-rbac-proxy-web/0.log" Jun 10 17:24:47.254515 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.254497 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/kube-rbac-proxy/0.log" Jun 10 17:24:47.283565 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.283546 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/kube-rbac-proxy-metric/0.log" Jun 10 17:24:47.312625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.312596 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/prom-label-proxy/0.log" Jun 10 17:24:47.355068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.355047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3eea43e0-7a76-4549-aea2-f03d0f5e2d0d/init-config-reloader/0.log" Jun 10 17:24:47.438443 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.438414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rrvsc_0e01c5b7-bf07-4e74-9619-b9460469f402/kube-state-metrics/0.log" Jun 10 17:24:47.466333 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.466309 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rrvsc_0e01c5b7-bf07-4e74-9619-b9460469f402/kube-rbac-proxy-main/0.log" Jun 10 17:24:47.489363 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.489279 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rrvsc_0e01c5b7-bf07-4e74-9619-b9460469f402/kube-rbac-proxy-self/0.log" Jun 10 17:24:47.787129 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.787057 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vbxmr_1775aeee-3738-4f90-869d-70ab84ae8023/node-exporter/0.log" Jun 10 17:24:47.810697 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.810661 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vbxmr_1775aeee-3738-4f90-869d-70ab84ae8023/kube-rbac-proxy/0.log" Jun 10 17:24:47.834720 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.834700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vbxmr_1775aeee-3738-4f90-869d-70ab84ae8023/init-textfile/0.log" Jun 10 17:24:47.970232 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:47.970206 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/prometheus/0.log" Jun 10 17:24:48.000246 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.000226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/config-reloader/0.log" Jun 10 17:24:48.028746 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.028729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/thanos-sidecar/0.log" Jun 10 17:24:48.054536 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.054481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/kube-rbac-proxy-web/0.log" Jun 10 17:24:48.078874 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.078853 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/kube-rbac-proxy/0.log" Jun 10 17:24:48.102673 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.102631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/kube-rbac-proxy-thanos/0.log" Jun 10 17:24:48.127966 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.127944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_846208f0-d187-4113-9704-53bc6cd76edd/init-config-reloader/0.log" Jun 10 17:24:48.155887 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.155865 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-lkvlg_52993eed-307c-4de8-8e92-0b5da6ac62a5/prometheus-operator/0.log" Jun 10 17:24:48.191203 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:48.191182 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-lkvlg_52993eed-307c-4de8-8e92-0b5da6ac62a5/kube-rbac-proxy/0.log" Jun 10 17:24:50.238083 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.238040 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x"] Jun 10 17:24:50.241730 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.241709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.244380 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.244358 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msnk6\"/\"openshift-service-ca.crt\"" Jun 10 17:24:50.244558 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.244537 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-msnk6\"/\"default-dockercfg-5xgx6\"" Jun 10 17:24:50.245714 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.245695 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msnk6\"/\"kube-root-ca.crt\"" Jun 10 17:24:50.250495 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.250433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x"] Jun 10 17:24:50.348621 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.348580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-sys\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.348621 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.348625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-lib-modules\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.348857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.348678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p79f\" (UniqueName: \"kubernetes.io/projected/07232f4d-2858-458c-a01e-6e688aa4148d-kube-api-access-5p79f\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.348857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.348779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-proc\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.348857 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.348844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-podres\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449452 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-sys\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-lib-modules\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p79f\" (UniqueName: \"kubernetes.io/projected/07232f4d-2858-458c-a01e-6e688aa4148d-kube-api-access-5p79f\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-proc\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449563 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-sys\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-podres\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449625 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449619 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-lib-modules\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449959 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-podres\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.449959 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.449677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07232f4d-2858-458c-a01e-6e688aa4148d-proc\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.458842 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.458821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p79f\" (UniqueName: \"kubernetes.io/projected/07232f4d-2858-458c-a01e-6e688aa4148d-kube-api-access-5p79f\") pod \"perf-node-gather-daemonset-kd52x\" (UID: \"07232f4d-2858-458c-a01e-6e688aa4148d\") " pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.553001 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.552914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.691460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.691434 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x"] Jun 10 17:24:50.693816 ip-10-0-141-107 kubenswrapper[2559]: W0610 17:24:50.693783 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod07232f4d_2858_458c_a01e_6e688aa4148d.slice/crio-5e9d3c5061a47bfc1e03597aa4f65258bd99afe252dcc001599b742ff59edc59 WatchSource:0}: Error finding container 5e9d3c5061a47bfc1e03597aa4f65258bd99afe252dcc001599b742ff59edc59: Status 404 returned error can't find the container with id 5e9d3c5061a47bfc1e03597aa4f65258bd99afe252dcc001599b742ff59edc59 Jun 10 17:24:50.883172 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.883077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" event={"ID":"07232f4d-2858-458c-a01e-6e688aa4148d","Type":"ContainerStarted","Data":"c59d60e48021b74fe45e2ed674be20afc2558b44b586639dbaebcbbabca570db"} Jun 10 17:24:50.883172 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.883133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" event={"ID":"07232f4d-2858-458c-a01e-6e688aa4148d","Type":"ContainerStarted","Data":"5e9d3c5061a47bfc1e03597aa4f65258bd99afe252dcc001599b742ff59edc59"} Jun 10 17:24:50.883172 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.883154 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:50.903486 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:50.903428 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" podStartSLOduration=0.903413444 podStartE2EDuration="903.413444ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:24:50.902007492 +0000 UTC m=+1072.050554609" watchObservedRunningTime="2026-06-10 17:24:50.903413444 +0000 UTC m=+1072.051960560" Jun 10 17:24:52.757475 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:52.757442 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2vb57_ffe23b43-6677-45fd-a4ee-faef86643502/dns/0.log" Jun 10 17:24:52.783592 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:52.783567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2vb57_ffe23b43-6677-45fd-a4ee-faef86643502/kube-rbac-proxy/0.log" Jun 10 17:24:52.946565 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:52.946529 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2zvv_7c5ad405-69e9-4e4f-a8df-5b73e613aaa5/dns-node-resolver/0.log" Jun 10 17:24:53.514405 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:53.514372 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b5d84cd5c-8wzpj_e5714815-3f22-439d-a08f-2c7846e53d8a/registry/0.log" Jun 10 17:24:53.536522 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:53.536499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-996t5_fe7417c7-2c66-4f31-837a-4bd1bfede250/node-ca/0.log" Jun 10 17:24:54.636986 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:54.636954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-vkg8g_015d5f2f-4ad7-4bbe-8485-8d87a99d2663/discovery/0.log" Jun 10 17:24:54.740318 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:54.740286 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-q8crc_5881f70d-2a9e-48f0-876d-3bee9b92f8e9/payload-pre-processing/0.log" Jun 10 17:24:54.768333 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:54.768307 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-frc7n_75237303-ce44-4f08-8a89-a8ed2e588cdd/payload-processing/0.log" Jun 10 17:24:55.453437 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:55.453409 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4gltv_28e59bbf-2444-4634-aae2-58edd6694123/serve-healthcheck-canary/0.log" Jun 10 17:24:56.144093 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:56.144066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbn2q_750ef407-6256-44ee-b7d4-ac5d2e396971/kube-rbac-proxy/0.log" Jun 10 17:24:56.168792 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:56.168763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbn2q_750ef407-6256-44ee-b7d4-ac5d2e396971/exporter/0.log" Jun 10 17:24:56.193320 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:56.193293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbn2q_750ef407-6256-44ee-b7d4-ac5d2e396971/extractor/0.log" Jun 10 17:24:56.898056 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:56.898027 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-msnk6/perf-node-gather-daemonset-kd52x" Jun 10 17:24:58.528965 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.528937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7df97bdc96-mjc6n_97d3361d-b23a-48b3-9fde-543c07dc4fe2/nginx/0.log" Jun 10 17:24:58.593928 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.593889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z2b9s_2d3c9461-1ca2-4562-a0ba-0c3ab2895759/manager/0.log" Jun 10 17:24:58.616479 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.616458 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-65498bc788-rwpxb_f7e9cdd5-e961-4e21-b842-d39aae673b5a/maas-api/0.log" Jun 10 17:24:58.650042 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.650021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-868d9989b5-gpxz6_371a625f-0ae0-4f3a-af7a-81ef5f277b58/manager/0.log" Jun 10 17:24:58.721523 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.721502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-b6d9c_ba64dce2-8fcd-4575-9a2f-a836d7b214ae/manager/0.log" Jun 10 17:24:58.750068 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.750030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f955fdfd-k9r8q_9a32a1a6-2668-4285-bbc2-abfa3b83a9e1/manager/0.log" Jun 10 17:24:58.801421 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:24:58.801353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f955fdfd-k9r8q_9a32a1a6-2668-4285-bbc2-abfa3b83a9e1/copy-manifests/0.log" Jun 10 17:25:00.866839 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:00.866807 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-846d788f49-p6rlj_750a2180-0b6f-4880-9d9e-25848feedd20/manager/0.log" Jun 10 17:25:04.206952 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:04.206915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-vkg8g_015d5f2f-4ad7-4bbe-8485-8d87a99d2663/discovery/0.log" Jun 10 17:25:04.271259 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:04.271230 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-q8crc_5881f70d-2a9e-48f0-876d-3bee9b92f8e9/payload-pre-processing/0.log" Jun 10 17:25:04.292929 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:04.292903 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-frc7n_75237303-ce44-4f08-8a89-a8ed2e588cdd/payload-processing/0.log" Jun 10 17:25:05.426467 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:05.426426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-vkg8g_015d5f2f-4ad7-4bbe-8485-8d87a99d2663/discovery/0.log" Jun 10 17:25:05.497573 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:05.497535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-q8crc_5881f70d-2a9e-48f0-876d-3bee9b92f8e9/payload-pre-processing/0.log" Jun 10 17:25:05.518338 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:05.518289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-frc7n_75237303-ce44-4f08-8a89-a8ed2e588cdd/payload-processing/0.log" Jun 10 17:25:07.284147 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:07.284116 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-vkg8g_015d5f2f-4ad7-4bbe-8485-8d87a99d2663/discovery/0.log" Jun 10 17:25:07.346460 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:07.346430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-q8crc_5881f70d-2a9e-48f0-876d-3bee9b92f8e9/payload-pre-processing/0.log" Jun 10 17:25:07.363386 ip-10-0-141-107 kubenswrapper[2559]: I0610 17:25:07.363347 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-frc7n_75237303-ce44-4f08-8a89-a8ed2e588cdd/payload-processing/0.log"