Jun 12 21:42:28.673700 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 21:42:28.673713 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 21:42:28.673723 ip-10-0-130-85 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 21:42:28.674038 ip-10-0-130-85 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 21:42:38.897251 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 21:42:38.897268 ip-10-0-130-85 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6a390aeecfb240a0a2999317aaa1d4d6 -- Jun 12 21:45:07.357351 ip-10-0-130-85 systemd[1]: Starting Kubernetes Kubelet... Jun 12 21:45:07.755585 ip-10-0-130-85 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:07.755585 ip-10-0-130-85 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 21:45:07.755585 ip-10-0-130-85 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:07.755585 ip-10-0-130-85 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 21:45:07.755585 ip-10-0-130-85 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:45:07.757902 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.757812 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 21:45:07.762233 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762213 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.762233 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762229 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.762233 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762236 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762240 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762245 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762249 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762253 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762257 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762260 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762264 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762269 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762273 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762277 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762281 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762294 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762298 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762302 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762306 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762310 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762314 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762319 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.762428 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762323 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762327 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762331 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762335 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762339 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762343 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762347 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762351 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762356 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762360 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762364 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762368 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762372 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762376 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762380 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762385 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762389 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762393 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762401 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762406 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.763235 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762411 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762416 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762421 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762425 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762430 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762434 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762438 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762442 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762446 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762450 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762454 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762458 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762463 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762467 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762472 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762476 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762480 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762484 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762490 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762494 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.763906 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762499 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762503 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762507 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762512 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762516 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762521 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762525 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762530 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762534 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762538 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762542 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762547 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762551 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762555 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762561 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762565 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762570 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762574 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762578 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.764506 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762583 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762587 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762593 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762602 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762606 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762611 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762615 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762619 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762625 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762632 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762636 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762641 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762646 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762650 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762655 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762659 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762663 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762667 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.764995 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.762672 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765194 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765206 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765211 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765216 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765220 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765225 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765229 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765234 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765238 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765247 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765252 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765256 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765260 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765264 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765268 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765274 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765278 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765282 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765286 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.765773 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765298 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765303 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765307 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765311 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765316 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765320 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765324 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765328 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765332 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765336 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765341 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765345 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765349 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765353 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765359 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765364 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765368 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765372 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765379 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.766689 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765386 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765390 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765394 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765398 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765403 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765408 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765412 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765416 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765420 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765425 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765429 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765434 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765438 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765442 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765446 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765450 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765455 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765460 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765465 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765469 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.767523 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765474 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765478 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765482 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765486 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765490 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765495 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765499 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765504 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765509 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765514 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765518 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765523 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765527 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765531 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765535 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765540 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765544 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765549 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765553 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765557 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765562 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.768361 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765566 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765570 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765574 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765578 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765582 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765591 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765598 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765604 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765609 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765614 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765619 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765623 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765627 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765632 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765636 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765640 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765644 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765649 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765653 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.768910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.765657 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766259 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766268 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766272 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766276 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766280 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766285 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766290 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766294 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766298 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766303 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766307 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766311 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766315 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766319 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766323 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766328 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766333 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766338 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.769501 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766343 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766347 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766352 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766356 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766360 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766365 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766369 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766375 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766383 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766388 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766393 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766397 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766403 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766407 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766412 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766416 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766420 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766424 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766428 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.770147 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766433 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766437 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766441 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766446 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766451 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766456 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766461 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766465 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766469 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766473 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766477 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766482 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766486 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766491 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766496 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766500 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766506 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766511 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766516 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766521 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.770651 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766525 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766530 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766535 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766539 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766544 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766548 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766554 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766558 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766562 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766567 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766571 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766575 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766579 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766583 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766587 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766592 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766596 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766601 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766605 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766610 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.771223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766614 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766618 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766623 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766628 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766632 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766640 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766644 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766648 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766653 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766656 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766661 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766665 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766669 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766674 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766678 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766682 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766686 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766690 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766694 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766698 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.771746 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766701 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.766705 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766812 2548 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766827 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766836 2548 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766843 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766850 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766854 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766861 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766867 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766873 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766879 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766884 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766890 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766894 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766899 2548 flags.go:64] FLAG: --cgroup-root="" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766904 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766911 2548 flags.go:64] FLAG: --client-ca-file="" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766915 2548 flags.go:64] FLAG: --cloud-provider="external" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766920 2548 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766927 2548 flags.go:64] FLAG: --cluster-domain="" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766932 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766937 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766942 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 21:45:07.772259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766947 2548 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766953 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766958 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766963 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766968 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766973 2548 flags.go:64] FLAG: --contention-profiling="false" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766978 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766983 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766987 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766992 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.766998 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767003 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767008 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767013 2548 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767017 2548 flags.go:64] FLAG: --enable-server="true" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767022 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767029 2548 flags.go:64] FLAG: --event-burst="100" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767033 2548 flags.go:64] FLAG: --event-qps="50" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767038 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767043 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767049 2548 flags.go:64] FLAG: --eviction-hard="" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767055 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767060 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767064 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767069 2548 flags.go:64] FLAG: --eviction-soft="" Jun 12 21:45:07.772837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767076 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767080 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767100 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767106 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767110 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767115 2548 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767120 2548 flags.go:64] FLAG: --feature-gates="" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767126 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767131 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767135 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767141 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767146 2548 flags.go:64] FLAG: --healthz-port="10248" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767151 2548 flags.go:64] FLAG: --help="false" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767156 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-130-85.ec2.internal" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767161 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767166 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767170 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767176 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767181 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767186 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767191 2548 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767196 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767201 2548 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 21:45:07.773474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767206 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767212 2548 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767216 2548 flags.go:64] FLAG: --kube-reserved="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767221 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767226 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767231 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767236 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767240 2548 flags.go:64] FLAG: --lock-file="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767245 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767251 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767256 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767265 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767269 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767274 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767279 2548 flags.go:64] FLAG: --logging-format="text" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767283 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767289 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767293 2548 flags.go:64] FLAG: --manifest-url="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767298 2548 flags.go:64] FLAG: --manifest-url-header="" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767305 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767309 2548 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767316 2548 flags.go:64] FLAG: --max-pods="110" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767321 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767326 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767330 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 21:45:07.774169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767335 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767340 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767344 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767349 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767361 2548 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767366 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767370 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767375 2548 flags.go:64] FLAG: --pod-cidr="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767380 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767388 2548 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767393 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767398 2548 flags.go:64] FLAG: --pods-per-core="0" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767403 2548 flags.go:64] FLAG: --port="10250" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767408 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767413 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c7b3f383a33f71e" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767418 2548 flags.go:64] FLAG: --qos-reserved="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767423 2548 flags.go:64] FLAG: --read-only-port="10255" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767430 2548 flags.go:64] FLAG: --register-node="true" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767434 2548 flags.go:64] FLAG: --register-with-taints="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767440 2548 flags.go:64] FLAG: --registry-burst="10" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767445 2548 flags.go:64] FLAG: --registry-qps="5" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767449 2548 flags.go:64] FLAG: --reserved-cpus="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767454 2548 flags.go:64] FLAG: --reserved-memory="" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767460 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767465 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 21:45:07.774771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767470 2548 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767474 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767479 2548 flags.go:64] FLAG: --runonce="false" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767484 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767491 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767496 2548 flags.go:64] FLAG: --seccomp-default="false" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767501 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767506 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767511 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767516 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767520 2548 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767525 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767529 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767534 2548 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767538 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767543 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767548 2548 flags.go:64] FLAG: --system-cgroups="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767552 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767562 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767566 2548 flags.go:64] FLAG: --tls-cert-file="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767572 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767579 2548 flags.go:64] FLAG: --tls-min-version="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767583 2548 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767588 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767594 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 21:45:07.775405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767599 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767604 2548 flags.go:64] FLAG: --v="2" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767610 2548 flags.go:64] FLAG: --version="false" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767616 2548 flags.go:64] FLAG: --vmodule="" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767622 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.767627 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767809 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767815 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767822 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767826 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767831 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767838 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767842 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767847 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767851 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767856 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767860 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767864 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767868 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767874 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767878 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.776018 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767882 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767886 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767891 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767897 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767903 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767908 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767913 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767918 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767922 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767926 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767932 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767936 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767940 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767945 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767949 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767953 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767957 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767961 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767965 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.776562 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767970 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767977 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767982 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767989 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767994 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.767998 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768003 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768007 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768011 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768015 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768020 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768024 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768028 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768033 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768037 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768041 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768045 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768049 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768054 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768058 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.777016 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768063 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768068 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768073 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768079 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768099 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768105 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768109 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768113 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768117 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768121 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768126 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768130 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768134 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768138 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768143 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768149 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768153 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768157 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768162 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.777582 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768166 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768170 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768175 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768179 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768183 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768188 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768192 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768197 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768201 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768206 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768210 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768214 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768218 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768223 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768227 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768232 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768238 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768242 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768246 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.778046 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768252 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768257 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768262 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768266 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768270 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768274 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.768278 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.768829 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.775350 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.775364 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.775383 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.775388 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775441 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775446 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775449 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.778522 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775452 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775456 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775459 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775461 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775464 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775467 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775469 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775472 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775474 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775477 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775480 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775483 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775485 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775488 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775490 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775493 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775495 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775498 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775500 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775503 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.778891 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775506 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775508 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775511 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775514 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775516 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775519 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775523 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775526 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775529 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775532 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775534 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775537 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775539 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775542 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775544 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775547 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775549 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775552 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775555 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775557 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.779399 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775560 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775562 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775565 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775568 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775572 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775576 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775578 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775581 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775583 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775586 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775588 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775592 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775596 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775599 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775602 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775604 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775607 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775610 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775613 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.779909 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775616 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775619 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775622 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775624 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775627 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775629 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775632 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775635 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775637 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775640 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775642 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775644 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775647 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775650 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775652 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775655 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775657 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775660 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775662 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775665 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.780381 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775668 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775670 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775673 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775675 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775677 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775680 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775682 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775685 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775687 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775690 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775692 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775695 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775698 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775702 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775706 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775709 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.780867 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775712 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.775717 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775826 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775830 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775833 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775837 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775840 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775842 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775846 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775850 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775852 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775855 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775857 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775860 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:45:07.781270 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775862 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775865 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775867 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775870 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775872 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775875 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775877 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775880 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775883 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775885 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775888 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775891 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775894 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775897 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775900 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775903 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775906 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775908 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775911 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775914 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:45:07.781617 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775916 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775919 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775921 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775923 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775926 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775928 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775931 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775933 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775936 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775938 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775941 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775943 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775946 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775948 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775951 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775953 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775956 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775958 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775960 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775963 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:45:07.782103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775966 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775968 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775971 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775973 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775976 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775978 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775981 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775983 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775986 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775989 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775991 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775993 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775996 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.775998 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776001 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776003 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776006 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776008 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776011 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776013 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:45:07.782580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776016 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776018 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776020 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776023 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776026 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776028 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776031 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776034 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776037 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776039 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776042 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776044 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776047 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776049 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776051 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776054 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776056 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776059 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776061 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776064 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:45:07.783052 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776067 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776069 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776072 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776074 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776077 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776079 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:07.776083 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.776103 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.776199 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.778417 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.780475 2548 server.go:1019] "Starting client certificate rotation" Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.780572 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:45:07.783538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.780611 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:45:07.783827 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.782699 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:45:07.786954 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.786930 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:45:07.794963 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.794946 2548 log.go:25] "Validated CRI v1 runtime API" Jun 12 21:45:07.797808 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.797699 2548 log.go:25] "Validated CRI v1 image API" Jun 12 21:45:07.799442 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.799427 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 21:45:07.801859 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.801841 2548 fs.go:135] Filesystem UUIDs: map[4992b946-e893-4db7-8cfc-d1c6d50a3145:/dev/nvme0n1p4 4e626ae0-5bfd-4e7e-a996-84b4d8b70a3e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 12 21:45:07.801905 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.801859 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 21:45:07.805625 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.805607 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:45:07.807356 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.807237 2548 manager.go:216] Machine: {Timestamp:2026-06-12 21:45:07.80591096 +0000 UTC m=+0.322050809 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103182 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e60082de923cf4301115435c86dab SystemUUID:ec2e6008-2de9-23cf-4301-115435c86dab BootID:6a390aee-cfb2-40a0-a299-9317aaa1d4d6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:08:2a:1d:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:08:2a:1d:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:e4:1f:ea:43:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 21:45:07.807356 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.807352 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 21:45:07.807452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.807422 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 21:45:07.809562 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.809538 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 21:45:07.809683 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.809564 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 21:45:07.810143 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.810134 2548 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 21:45:07.810180 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.810146 2548 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 21:45:07.810180 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.810154 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:45:07.810826 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.810817 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:45:07.812274 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.812264 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 21:45:07.815437 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815426 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:45:07.815548 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815539 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 21:45:07.815585 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815566 2548 kubelet.go:486] "Attempting to sync node with API server" Jun 12 21:45:07.815585 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815576 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 21:45:07.815645 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815589 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 21:45:07.815645 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815598 2548 kubelet.go:398] "Adding apiserver pod source" Jun 12 21:45:07.815645 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815607 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 21:45:07.815901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815891 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:45:07.815933 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.815910 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:45:07.818031 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.818011 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 21:45:07.819355 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819341 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 21:45:07.819426 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819370 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 21:45:07.819537 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819525 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 21:45:07.819567 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819546 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 21:45:07.819567 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819553 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 21:45:07.819567 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819559 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 21:45:07.819644 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819569 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 21:45:07.819644 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.819587 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 21:45:07.820210 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820201 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 21:45:07.820210 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820209 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 21:45:07.820323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820216 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 21:45:07.820323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820222 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 21:45:07.820323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820234 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 21:45:07.820323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820241 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 21:45:07.820908 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820898 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 21:45:07.820945 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.820910 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 21:45:07.823878 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.823862 2548 server.go:1268] "Started kubelet" Jun 12 21:45:07.823989 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.823917 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 21:45:07.824118 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.824017 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 21:45:07.824208 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.824149 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 21:45:07.828073 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.828045 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 21:45:07.828299 ip-10-0-130-85 systemd[1]: Started Kubernetes Kubelet. Jun 12 21:45:07.828643 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.828621 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtp9p" Jun 12 21:45:07.830131 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.830115 2548 server.go:310] "Adding debug handlers to kubelet server" Jun 12 21:45:07.830689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.830666 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 21:45:07.830827 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.830700 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 21:45:07.831400 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.831372 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 21:45:07.832481 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.832457 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtp9p" Jun 12 21:45:07.835051 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.834171 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-85.ec2.internal.18b8738e57fda75b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-85.ec2.internal,UID:ip-10-0-130-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-85.ec2.internal,},FirstTimestamp:2026-06-12 21:45:07.823822683 +0000 UTC m=+0.339962532,LastTimestamp:2026-06-12 21:45:07.823822683 +0000 UTC m=+0.339962532,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-85.ec2.internal,}" Jun 12 21:45:07.835172 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.835150 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 21:45:07.836465 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.836450 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 21:45:07.836533 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.836464 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 21:45:07.836533 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.836509 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:07.837008 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.836991 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 21:45:07.837008 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837011 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 21:45:07.837425 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837407 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 21:45:07.837588 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837539 2548 factory.go:153] Registering CRI-O factory Jun 12 21:45:07.837588 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837553 2548 factory.go:223] Registration of the crio container factory successfully Jun 12 21:45:07.837689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837600 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 21:45:07.837689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837607 2548 factory.go:55] Registering systemd factory Jun 12 21:45:07.837689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837614 2548 factory.go:223] Registration of the systemd container factory successfully Jun 12 21:45:07.837689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837634 2548 factory.go:103] Registering Raw factory Jun 12 21:45:07.837689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.837648 2548 manager.go:1196] Started watching for new ooms in manager Jun 12 21:45:07.838042 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.838027 2548 manager.go:349] Starting recovery of all containers Jun 12 21:45:07.838173 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.838147 2548 reconstruct.go:97] "Volume reconstruction finished" Jun 12 21:45:07.838173 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.838161 2548 reconciler.go:29] "Reconciler: start to sync state" Jun 12 21:45:07.843736 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.843694 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:07.846662 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.846626 2548 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-85.ec2.internal\" not found" node="ip-10-0-130-85.ec2.internal" Jun 12 21:45:07.848402 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.848388 2548 manager.go:354] Recovery completed Jun 12 21:45:07.852683 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.852671 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:07.854737 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.854723 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:07.854790 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.854756 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:07.854790 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.854770 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:07.855286 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855275 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 21:45:07.855286 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855285 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 21:45:07.855362 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855289 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:07.855362 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855300 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:45:07.855917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855902 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:07.855995 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855932 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:07.855995 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.855947 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:07.856574 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.856562 2548 policy_none.go:49] "None policy: Start" Jun 12 21:45:07.856614 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.856577 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 21:45:07.856614 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.856587 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 21:45:07.857625 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.857614 2548 policy_none.go:47] "Start" Jun 12 21:45:07.905630 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.905607 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.906793 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.906824 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.906844 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.906873 2548 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.908765 2548 manager.go:337] "Starting Device Plugin manager" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.908838 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.908850 2548 server.go:87] "Starting device plugin registration server" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909102 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909114 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909239 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909375 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909384 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:07.909598 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.909942 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 21:45:07.914290 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:07.909991 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.007708 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.007622 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal"] Jun 12 21:45:08.007708 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.007702 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:08.008785 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.008769 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:08.008861 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.008801 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:08.008861 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.008816 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:08.009965 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.009950 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:08.010238 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010225 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:08.010323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010310 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.010368 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010360 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:08.010714 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010698 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:08.010764 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010727 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:08.010764 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010737 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:08.010764 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010759 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.010867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010698 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:08.010867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010789 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:08.010867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010802 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:08.010993 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.010970 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:08.011043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.011000 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:08.011043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.011016 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:08.012279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.012265 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.012345 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.012289 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:45:08.012919 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.012903 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:45:08.012998 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.012931 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:45:08.012998 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.012944 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:45:08.018299 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.018284 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.018367 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.018303 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-85.ec2.internal\": node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.033567 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.033545 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.034635 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.034618 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-85.ec2.internal\" not found" node="ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.038801 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.038783 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.038879 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.038830 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-85.ec2.internal\" not found" node="ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.038879 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.038846 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.038965 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.038878 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81fc4e7aa9137b7763fe31c6de7fca21-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"81fc4e7aa9137b7763fe31c6de7fca21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.134586 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.134560 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.139926 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.139910 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.139991 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.139931 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.139991 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.139964 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.139991 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.139981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81fc4e7aa9137b7763fe31c6de7fca21-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"81fc4e7aa9137b7763fe31c6de7fca21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.140112 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.140013 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81fc4e7aa9137b7763fe31c6de7fca21-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"81fc4e7aa9137b7763fe31c6de7fca21\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.140112 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.140043 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fc775950d8357e5c00266372fec2e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"16fc775950d8357e5c00266372fec2e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.235621 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.235593 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.336323 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.336258 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.337374 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.337353 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.342570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.342551 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.436938 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.436907 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.537361 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.537332 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.637827 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.637760 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 12 21:45:08.725608 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.725584 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:08.737416 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.737391 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.750177 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.750155 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:45:08.751612 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.751600 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 12 21:45:08.758479 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.758462 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:45:08.779597 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.779579 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 21:45:08.779713 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.779692 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 21:45:08.779774 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.779732 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 21:45:08.779774 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.779733 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 21:45:08.806455 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:08.806425 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fc4e7aa9137b7763fe31c6de7fca21.slice/crio-b92bae9e5f485543fa82359de8d0f07803f716e84c80d9ccf67fb6489e8ed3b8 WatchSource:0}: Error finding container b92bae9e5f485543fa82359de8d0f07803f716e84c80d9ccf67fb6489e8ed3b8: Status 404 returned error can't find the container with id b92bae9e5f485543fa82359de8d0f07803f716e84c80d9ccf67fb6489e8ed3b8 Jun 12 21:45:08.806842 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:08.806821 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fc775950d8357e5c00266372fec2e4.slice/crio-3bfb08c7c9ff70dace6cfe06d1d2918399c85698662365dd8b8b0bcbbc94657b WatchSource:0}: Error finding container 3bfb08c7c9ff70dace6cfe06d1d2918399c85698662365dd8b8b0bcbbc94657b: Status 404 returned error can't find the container with id 3bfb08c7c9ff70dace6cfe06d1d2918399c85698662365dd8b8b0bcbbc94657b Jun 12 21:45:08.811020 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.811004 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:45:08.816441 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.816426 2548 apiserver.go:52] "Watching apiserver" Jun 12 21:45:08.827410 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.827390 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 21:45:08.828898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.828876 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-trzn4","kube-system/global-pull-secret-syncer-9qtbs","kube-system/konnectivity-agent-qf89h","kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cd89m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal","openshift-multus/multus-595vf","openshift-multus/network-metrics-daemon-m4w6v","openshift-network-operator/iptables-alerter-chdmg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf","openshift-dns/node-resolver-c8bv9","openshift-image-registry/node-ca-djxr8","openshift-multus/multus-additional-cni-plugins-xxpfx","openshift-network-diagnostics/network-check-target-ftphq"] Jun 12 21:45:08.831114 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.831097 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.832330 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.832308 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.832416 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.832385 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:08.833182 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833166 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 21:45:08.833274 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833256 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.833338 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833282 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.833389 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833327 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 21:45:08.833389 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833367 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x4bnp\"" Jun 12 21:45:08.833479 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833465 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 21:45:08.833568 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833550 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 21:45:08.833674 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.833661 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.835032 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.835016 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.835805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.835791 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-stvh6\"" Jun 12 21:45:08.835873 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.835795 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 21:45:08.836392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.836374 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-595vf" Jun 12 21:45:08.836530 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.836501 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 21:40:07 +0000 UTC" deadline="2028-03-28 16:42:44.293155926 +0000 UTC" Jun 12 21:45:08.836589 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.836531 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15714h57m35.456627942s" Jun 12 21:45:08.836589 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.836534 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 21:45:08.837228 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.837208 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 21:45:08.837347 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.837330 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdlfl\"" Jun 12 21:45:08.837480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.837467 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.837676 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.837653 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.838165 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.837839 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.838165 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.837923 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:08.838399 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.838385 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fzh5k\"" Jun 12 21:45:08.838659 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.838644 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 21:45:08.838733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.838721 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 21:45:08.838790 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.838750 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.838830 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.838800 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.839178 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.839158 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:08.840641 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.840623 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.841188 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.841166 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 21:45:08.841571 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.841541 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.841670 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.841624 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-msbnn\"" Jun 12 21:45:08.841856 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.841839 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.842185 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.842116 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:08.842769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.842676 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 21:45:08.842968 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.842950 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.843039 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.842947 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843637 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-ovn\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843690 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-env-overrides\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843753 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-kubelet-config\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843785 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-dbus\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843841 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-host\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843870 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-k8s-cni-cncf-io\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843907 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-netns\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843943 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-netns\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.843983 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-kubelet\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.844035 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844012 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.844560 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844055 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-conf-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.844560 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844100 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.844662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844591 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkgjr\" (UniqueName: \"kubernetes.io/projected/05a75ae9-263e-4a70-9bf8-80e4dab0a738-kube-api-access-bkgjr\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.844662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.844662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844626 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rld9s\"" Jun 12 21:45:08.844806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844681 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-log-socket\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.844806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844701 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.844806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844709 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-conf\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.844806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844740 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kbw\" (UniqueName: \"kubernetes.io/projected/44dbfcfb-7f95-4372-90c3-836dc7b5c429-kube-api-access-v5kbw\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.844806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-socket-dir-parent\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844798 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-config\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844901 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e49afc2-528d-40c5-ade4-27a997d53787-ovn-node-metrics-cert\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844907 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cxrmn\"" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.844938 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-system-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845011 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-multus-certs\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845081 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-slash\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845118 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845178 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-lib-modules\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845215 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-var-lib-kubelet\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845258 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-kubernetes\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845296 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-hostroot\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845357 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-systemd-units\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845404 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845443 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6t7p\" (UniqueName: \"kubernetes.io/projected/7e49afc2-528d-40c5-ade4-27a997d53787-kube-api-access-v6t7p\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845506 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2433ca0c-1727-45c6-ad10-ac5344109b2f-konnectivity-ca\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845543 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-systemd\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845571 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tt8j\" (UniqueName: \"kubernetes.io/projected/f3a93124-08d7-405c-9530-a95446fc306a-kube-api-access-2tt8j\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845606 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-systemd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845635 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845681 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-multus\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.845719 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845711 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-bin\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846023 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845753 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-daemon-config\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.846023 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845782 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-var-lib-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846023 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845921 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-etc-kubernetes\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.846023 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.845994 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-etc-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846230 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846062 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:08.846230 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846126 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-node-log\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846320 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846188 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-tuned\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.846320 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846267 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-script-lib\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846335 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2433ca0c-1727-45c6-ad10-ac5344109b2f-agent-certs\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.846432 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846387 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-kubelet\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846484 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846460 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846534 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846518 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-netd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.846583 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846566 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-modprobe-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.846627 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846612 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysconfig\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.846754 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846708 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-os-release\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.846914 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846844 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-run\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.846951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846938 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-sys\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.847008 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.846989 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cnibin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.847074 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.847040 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-tmp\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.847175 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.847158 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cni-binary-copy\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.847233 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.847202 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-bin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.847233 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.847223 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.847771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.847753 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.848257 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.848233 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-chnbk\"" Jun 12 21:45:08.848344 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.848271 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 21:45:08.848392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.848373 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 21:45:08.848433 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.848397 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 21:45:08.849144 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.849126 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:08.849217 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.849175 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:08.849644 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.849626 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 21:45:08.849827 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.849811 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 21:45:08.849886 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.849875 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5z8t5\"" Jun 12 21:45:08.851122 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.851106 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:45:08.876283 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.876267 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6vfmv" Jun 12 21:45:08.883597 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.883576 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6vfmv" Jun 12 21:45:08.910337 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.910269 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"16fc775950d8357e5c00266372fec2e4","Type":"ContainerStarted","Data":"3bfb08c7c9ff70dace6cfe06d1d2918399c85698662365dd8b8b0bcbbc94657b"} Jun 12 21:45:08.911232 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.911210 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" event={"ID":"81fc4e7aa9137b7763fe31c6de7fca21","Type":"ContainerStarted","Data":"b92bae9e5f485543fa82359de8d0f07803f716e84c80d9ccf67fb6489e8ed3b8"} Jun 12 21:45:08.939179 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.939165 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 21:45:08.947500 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947484 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.947587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947513 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fafc2-56cc-45d8-8a99-d388033f7a9b-tmp-dir\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:08.947587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947535 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dece1d5-2ffa-4174-b840-d283f95de207-host\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:08.947587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947549 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dece1d5-2ffa-4174-b840-d283f95de207-serviceca\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:08.947587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947569 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-k8s-cni-cncf-io\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947600 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-netns\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947615 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-k8s-cni-cncf-io\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ce4da2c-33c6-4363-85ae-0531965e1c7b-iptables-alerter-script\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947643 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-netns\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947672 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-kubelet\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947677 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-netns\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947676 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-netns\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947699 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947719 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-kubelet\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947722 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-conf-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947754 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.947762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947758 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-conf-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947778 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-socket-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947814 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkgjr\" (UniqueName: \"kubernetes.io/projected/05a75ae9-263e-4a70-9bf8-80e4dab0a738-kube-api-access-bkgjr\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947831 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-log-socket\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947868 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ce4da2c-33c6-4363-85ae-0531965e1c7b-host-slash\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947890 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-conf\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947895 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947848 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947897 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-log-socket\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947908 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kbw\" (UniqueName: \"kubernetes.io/projected/44dbfcfb-7f95-4372-90c3-836dc7b5c429-kube-api-access-v5kbw\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947945 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-socket-dir-parent\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947970 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-config\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.947851 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947994 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e49afc2-528d-40c5-ade4-27a997d53787-ovn-node-metrics-cert\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.947999 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysctl-conf\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948027 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-socket-dir-parent\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948037 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cjdk\" (UniqueName: \"kubernetes.io/projected/e65fafc2-56cc-45d8-8a99-d388033f7a9b-kube-api-access-8cjdk\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.948061 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:09.448036212 +0000 UTC m=+1.964176063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948115 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-system-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-multus-certs\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948172 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-slash\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948180 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-system-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948199 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-device-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948201 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-run-multus-certs\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948240 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-slash\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2csmx\" (UniqueName: \"kubernetes.io/projected/3e3a75f2-e2e1-46ed-b8ed-def392775f38-kube-api-access-2csmx\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948303 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-lib-modules\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-var-lib-kubelet\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948337 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948350 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-kubernetes\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948381 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-hostroot\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948399 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-lib-modules\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948438 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-kubernetes\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.948846 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948440 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-hostroot\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948547 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-systemd-units\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948474 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-systemd-units\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.948466 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-var-lib-kubelet\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949074 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-config\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949118 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949166 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6t7p\" (UniqueName: \"kubernetes.io/projected/7e49afc2-528d-40c5-ade4-27a997d53787-kube-api-access-v6t7p\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949201 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949212 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2433ca0c-1727-45c6-ad10-ac5344109b2f-konnectivity-ca\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949243 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-systemd\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949271 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tt8j\" (UniqueName: \"kubernetes.io/projected/f3a93124-08d7-405c-9530-a95446fc306a-kube-api-access-2tt8j\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949302 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-systemd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949334 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fafc2-56cc-45d8-8a99-d388033f7a9b-hosts-file\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949396 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-systemd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.949570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949557 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-systemd\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949696 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-system-cni-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949731 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-os-release\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949766 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949796 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-multus\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-bin\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949868 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-daemon-config\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949900 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-var-lib-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949932 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-etc-kubernetes\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-etc-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.949984 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-node-log\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950017 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950046 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-tuned\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950079 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-script-lib\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950126 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2433ca0c-1727-45c6-ad10-ac5344109b2f-agent-certs\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950193 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-cni-dir\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950243 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-etc-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950254 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-multus\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950305 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-etc-kubernetes\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950345 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-bin\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950380 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgwz\" (UniqueName: \"kubernetes.io/projected/5ce4da2c-33c6-4363-85ae-0531965e1c7b-kube-api-access-fvgwz\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950415 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950452 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-kubelet\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950514 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-netd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950540 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-registration-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950572 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-sys-fs\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950602 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dsnt\" (UniqueName: \"kubernetes.io/projected/1dece1d5-2ffa-4174-b840-d283f95de207-kube-api-access-6dsnt\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950633 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-modprobe-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950686 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysconfig\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950715 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.950964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950746 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jzqb\" (UniqueName: \"kubernetes.io/projected/e36234f1-e943-4f50-906b-405961fe45dd-kube-api-access-9jzqb\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950778 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950805 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950836 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-os-release\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950046 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2433ca0c-1727-45c6-ad10-ac5344109b2f-konnectivity-ca\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950195 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-var-lib-openvswitch\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950925 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-node-log\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950995 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-kubelet\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951038 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-run-ovn-kubernetes\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951081 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-host-cni-netd\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951225 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-modprobe-d\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951295 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-sysconfig\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951393 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-ovnkube-script-lib\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.951666 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951401 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-os-release\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.950869 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-run\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951790 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-sys\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951839 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-multus-daemon-config\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951859 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-run\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951827 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cnibin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951954 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-sys\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951903 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cnibin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.951995 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cnibin\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-tmp\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952064 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cni-binary-copy\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952105 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-bin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952258 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952136 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952172 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-ovn\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-env-overrides\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952453 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-kubelet-config\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952465 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e49afc2-528d-40c5-ade4-27a997d53787-run-ovn\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952478 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-dbus\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952507 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-host\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952288 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05a75ae9-263e-4a70-9bf8-80e4dab0a738-host-var-lib-cni-bin\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952601 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44dbfcfb-7f95-4372-90c3-836dc7b5c429-host\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952258 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e49afc2-528d-40c5-ade4-27a997d53787-ovn-node-metrics-cert\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952676 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-etc-tuned\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.952372 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952740 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05a75ae9-263e-4a70-9bf8-80e4dab0a738-cni-binary-copy\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:08.952770 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:09.452752242 +0000 UTC m=+1.968892086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952711 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-kubelet-config\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.952796 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952797 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-dbus\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:08.953460 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.952979 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e49afc2-528d-40c5-ade4-27a997d53787-env-overrides\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:08.954435 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.954415 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2433ca0c-1727-45c6-ad10-ac5344109b2f-agent-certs\") pod \"konnectivity-agent-qf89h\" (UID: \"2433ca0c-1727-45c6-ad10-ac5344109b2f\") " pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:08.955101 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.955072 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44dbfcfb-7f95-4372-90c3-836dc7b5c429-tmp\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.955651 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.955636 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkgjr\" (UniqueName: \"kubernetes.io/projected/05a75ae9-263e-4a70-9bf8-80e4dab0a738-kube-api-access-bkgjr\") pod \"multus-595vf\" (UID: \"05a75ae9-263e-4a70-9bf8-80e4dab0a738\") " pod="openshift-multus/multus-595vf" Jun 12 21:45:08.958280 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.958264 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kbw\" (UniqueName: \"kubernetes.io/projected/44dbfcfb-7f95-4372-90c3-836dc7b5c429-kube-api-access-v5kbw\") pod \"tuned-cd89m\" (UID: \"44dbfcfb-7f95-4372-90c3-836dc7b5c429\") " pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:08.959910 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.959886 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tt8j\" (UniqueName: \"kubernetes.io/projected/f3a93124-08d7-405c-9530-a95446fc306a-kube-api-access-2tt8j\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:08.960168 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:08.960152 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6t7p\" (UniqueName: \"kubernetes.io/projected/7e49afc2-528d-40c5-ade4-27a997d53787-kube-api-access-v6t7p\") pod \"ovnkube-node-trzn4\" (UID: \"7e49afc2-528d-40c5-ade4-27a997d53787\") " pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:09.053736 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053710 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fafc2-56cc-45d8-8a99-d388033f7a9b-hosts-file\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.053736 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053735 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-system-cni-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-os-release\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053768 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053802 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgwz\" (UniqueName: \"kubernetes.io/projected/5ce4da2c-33c6-4363-85ae-0531965e1c7b-kube-api-access-fvgwz\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053839 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053859 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-os-release\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053871 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-system-cni-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053887 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-registration-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053837 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fafc2-56cc-45d8-8a99-d388033f7a9b-hosts-file\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053910 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-sys-fs\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.053925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053926 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053925 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dsnt\" (UniqueName: \"kubernetes.io/projected/1dece1d5-2ffa-4174-b840-d283f95de207-kube-api-access-6dsnt\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053948 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-registration-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.053983 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054019 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-sys-fs\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054041 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jzqb\" (UniqueName: \"kubernetes.io/projected/e36234f1-e943-4f50-906b-405961fe45dd-kube-api-access-9jzqb\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054160 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054173 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054200 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054228 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cnibin\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054272 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054295 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fafc2-56cc-45d8-8a99-d388033f7a9b-tmp-dir\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054377 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cnibin\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054377 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.054419 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054419 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dece1d5-2ffa-4174-b840-d283f95de207-host\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054427 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054436 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dece1d5-2ffa-4174-b840-d283f95de207-serviceca\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054470 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dece1d5-2ffa-4174-b840-d283f95de207-host\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054487 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ce4da2c-33c6-4363-85ae-0531965e1c7b-iptables-alerter-script\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054520 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-socket-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054538 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ce4da2c-33c6-4363-85ae-0531965e1c7b-host-slash\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054573 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cjdk\" (UniqueName: \"kubernetes.io/projected/e65fafc2-56cc-45d8-8a99-d388033f7a9b-kube-api-access-8cjdk\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054575 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fafc2-56cc-45d8-8a99-d388033f7a9b-tmp-dir\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054615 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ce4da2c-33c6-4363-85ae-0531965e1c7b-host-slash\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054643 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-socket-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054652 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-device-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054668 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e3a75f2-e2e1-46ed-b8ed-def392775f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054682 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2csmx\" (UniqueName: \"kubernetes.io/projected/3e3a75f2-e2e1-46ed-b8ed-def392775f38-kube-api-access-2csmx\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054730 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e36234f1-e943-4f50-906b-405961fe45dd-device-dir\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054845 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1dece1d5-2ffa-4174-b840-d283f95de207-serviceca\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.055017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.054936 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ce4da2c-33c6-4363-85ae-0531965e1c7b-iptables-alerter-script\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.060126 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.060102 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:09.060126 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.060124 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:09.060126 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.060134 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:09.060342 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.060194 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:09.560181269 +0000 UTC m=+2.076321124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:09.062135 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.062105 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2csmx\" (UniqueName: \"kubernetes.io/projected/3e3a75f2-e2e1-46ed-b8ed-def392775f38-kube-api-access-2csmx\") pod \"multus-additional-cni-plugins-xxpfx\" (UID: \"3e3a75f2-e2e1-46ed-b8ed-def392775f38\") " pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.062135 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.062118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cjdk\" (UniqueName: \"kubernetes.io/projected/e65fafc2-56cc-45d8-8a99-d388033f7a9b-kube-api-access-8cjdk\") pod \"node-resolver-c8bv9\" (UID: \"e65fafc2-56cc-45d8-8a99-d388033f7a9b\") " pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.062135 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.062126 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgwz\" (UniqueName: \"kubernetes.io/projected/5ce4da2c-33c6-4363-85ae-0531965e1c7b-kube-api-access-fvgwz\") pod \"iptables-alerter-chdmg\" (UID: \"5ce4da2c-33c6-4363-85ae-0531965e1c7b\") " pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.062857 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.062839 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jzqb\" (UniqueName: \"kubernetes.io/projected/e36234f1-e943-4f50-906b-405961fe45dd-kube-api-access-9jzqb\") pod \"aws-ebs-csi-driver-node-fgnwf\" (UID: \"e36234f1-e943-4f50-906b-405961fe45dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.062931 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.062893 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dsnt\" (UniqueName: \"kubernetes.io/projected/1dece1d5-2ffa-4174-b840-d283f95de207-kube-api-access-6dsnt\") pod \"node-ca-djxr8\" (UID: \"1dece1d5-2ffa-4174-b840-d283f95de207\") " pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.142674 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.142644 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:09.150718 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.150698 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:09.152910 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.152884 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e49afc2_528d_40c5_ade4_27a997d53787.slice/crio-3532e756d8679bd2a59a9e33d4e79b7cd13c3204867db1c89eb4ef9905b0dda7 WatchSource:0}: Error finding container 3532e756d8679bd2a59a9e33d4e79b7cd13c3204867db1c89eb4ef9905b0dda7: Status 404 returned error can't find the container with id 3532e756d8679bd2a59a9e33d4e79b7cd13c3204867db1c89eb4ef9905b0dda7 Jun 12 21:45:09.156403 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.156380 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cd89m" Jun 12 21:45:09.158652 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.158629 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2433ca0c_1727_45c6_ad10_ac5344109b2f.slice/crio-57eb4f06c4566f187fd1ba89f9fab492bbde42f920ecd92ee62acc61a97e319d WatchSource:0}: Error finding container 57eb4f06c4566f187fd1ba89f9fab492bbde42f920ecd92ee62acc61a97e319d: Status 404 returned error can't find the container with id 57eb4f06c4566f187fd1ba89f9fab492bbde42f920ecd92ee62acc61a97e319d Jun 12 21:45:09.161706 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.161672 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-595vf" Jun 12 21:45:09.163178 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.163104 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dbfcfb_7f95_4372_90c3_836dc7b5c429.slice/crio-a76e96f3b97acc35d28388839e6de9d8a9806404cf2936cc3382eb9846d9c3b6 WatchSource:0}: Error finding container a76e96f3b97acc35d28388839e6de9d8a9806404cf2936cc3382eb9846d9c3b6: Status 404 returned error can't find the container with id a76e96f3b97acc35d28388839e6de9d8a9806404cf2936cc3382eb9846d9c3b6 Jun 12 21:45:09.167128 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.167048 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-chdmg" Jun 12 21:45:09.169488 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.169080 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a75ae9_263e_4a70_9bf8_80e4dab0a738.slice/crio-9b811f17fc8f54ab8c826b61daa17dd4ac4ee9f4c408bec8c65bb0116e97b1aa WatchSource:0}: Error finding container 9b811f17fc8f54ab8c826b61daa17dd4ac4ee9f4c408bec8c65bb0116e97b1aa: Status 404 returned error can't find the container with id 9b811f17fc8f54ab8c826b61daa17dd4ac4ee9f4c408bec8c65bb0116e97b1aa Jun 12 21:45:09.171916 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.171775 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" Jun 12 21:45:09.174932 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.174910 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce4da2c_33c6_4363_85ae_0531965e1c7b.slice/crio-30bc856dcbf953559474a0ac6eb9e9bb76eef21e3f438f236e19f2bdee252b32 WatchSource:0}: Error finding container 30bc856dcbf953559474a0ac6eb9e9bb76eef21e3f438f236e19f2bdee252b32: Status 404 returned error can't find the container with id 30bc856dcbf953559474a0ac6eb9e9bb76eef21e3f438f236e19f2bdee252b32 Jun 12 21:45:09.176820 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.176803 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c8bv9" Jun 12 21:45:09.180223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.180199 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36234f1_e943_4f50_906b_405961fe45dd.slice/crio-2b886230502248a6954d01675845ed7cfc958280bcba4d79b5c8f3537a634c4d WatchSource:0}: Error finding container 2b886230502248a6954d01675845ed7cfc958280bcba4d79b5c8f3537a634c4d: Status 404 returned error can't find the container with id 2b886230502248a6954d01675845ed7cfc958280bcba4d79b5c8f3537a634c4d Jun 12 21:45:09.181771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.181688 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-djxr8" Jun 12 21:45:09.185406 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.185384 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65fafc2_56cc_45d8_8a99_d388033f7a9b.slice/crio-a91fc018a5b80af50bcb4a1bc6a4c5e9eac3684a4da6ff152d93b1f31898cdc5 WatchSource:0}: Error finding container a91fc018a5b80af50bcb4a1bc6a4c5e9eac3684a4da6ff152d93b1f31898cdc5: Status 404 returned error can't find the container with id a91fc018a5b80af50bcb4a1bc6a4c5e9eac3684a4da6ff152d93b1f31898cdc5 Jun 12 21:45:09.186016 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.185999 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" Jun 12 21:45:09.190604 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.190575 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dece1d5_2ffa_4174_b840_d283f95de207.slice/crio-477f8abfde37ca06ed351e39ad417979f542bcbeb1a274af926d13150d95f7fc WatchSource:0}: Error finding container 477f8abfde37ca06ed351e39ad417979f542bcbeb1a274af926d13150d95f7fc: Status 404 returned error can't find the container with id 477f8abfde37ca06ed351e39ad417979f542bcbeb1a274af926d13150d95f7fc Jun 12 21:45:09.195688 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:09.195669 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3a75f2_e2e1_46ed_b8ed_def392775f38.slice/crio-500b0a1cc9f7732cfb5bcf26ec5acefc9c8281ee1e355b6797ab422a8b8b63ef WatchSource:0}: Error finding container 500b0a1cc9f7732cfb5bcf26ec5acefc9c8281ee1e355b6797ab422a8b8b63ef: Status 404 returned error can't find the container with id 500b0a1cc9f7732cfb5bcf26ec5acefc9c8281ee1e355b6797ab422a8b8b63ef Jun 12 21:45:09.423932 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.423767 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:09.457216 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.457181 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:09.457384 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.457237 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:09.457384 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.457345 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:09.457497 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.457391 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:09.457497 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.457409 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:10.457389733 +0000 UTC m=+2.973529588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:09.457497 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.457443 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:10.457426826 +0000 UTC m=+2.973566702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:09.594504 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.594470 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:09.659417 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.658791 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:09.659417 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.658990 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:09.659417 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.659008 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:09.659417 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.659030 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:09.659417 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.659101 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:10.659068681 +0000 UTC m=+3.175208521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:09.885759 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.885553 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:40:08 +0000 UTC" deadline="2027-12-15 07:20:51.957373616 +0000 UTC" Jun 12 21:45:09.885759 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.885607 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13209h35m42.071770663s" Jun 12 21:45:09.908838 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.908195 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:09.908838 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.908326 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:09.908838 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.908707 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:09.908838 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:09.908795 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:09.915193 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.914987 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:09.938818 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.938769 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cd89m" event={"ID":"44dbfcfb-7f95-4372-90c3-836dc7b5c429","Type":"ContainerStarted","Data":"a76e96f3b97acc35d28388839e6de9d8a9806404cf2936cc3382eb9846d9c3b6"} Jun 12 21:45:09.956432 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.956395 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"3532e756d8679bd2a59a9e33d4e79b7cd13c3204867db1c89eb4ef9905b0dda7"} Jun 12 21:45:09.969370 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.969306 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-djxr8" event={"ID":"1dece1d5-2ffa-4174-b840-d283f95de207","Type":"ContainerStarted","Data":"477f8abfde37ca06ed351e39ad417979f542bcbeb1a274af926d13150d95f7fc"} Jun 12 21:45:09.974160 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.974078 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c8bv9" event={"ID":"e65fafc2-56cc-45d8-8a99-d388033f7a9b","Type":"ContainerStarted","Data":"a91fc018a5b80af50bcb4a1bc6a4c5e9eac3684a4da6ff152d93b1f31898cdc5"} Jun 12 21:45:09.976405 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.976330 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-chdmg" event={"ID":"5ce4da2c-33c6-4363-85ae-0531965e1c7b","Type":"ContainerStarted","Data":"30bc856dcbf953559474a0ac6eb9e9bb76eef21e3f438f236e19f2bdee252b32"} Jun 12 21:45:09.988436 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.988405 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-595vf" event={"ID":"05a75ae9-263e-4a70-9bf8-80e4dab0a738","Type":"ContainerStarted","Data":"9b811f17fc8f54ab8c826b61daa17dd4ac4ee9f4c408bec8c65bb0116e97b1aa"} Jun 12 21:45:09.995539 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.995475 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qf89h" event={"ID":"2433ca0c-1727-45c6-ad10-ac5344109b2f","Type":"ContainerStarted","Data":"57eb4f06c4566f187fd1ba89f9fab492bbde42f920ecd92ee62acc61a97e319d"} Jun 12 21:45:09.997706 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:09.997628 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerStarted","Data":"500b0a1cc9f7732cfb5bcf26ec5acefc9c8281ee1e355b6797ab422a8b8b63ef"} Jun 12 21:45:10.000102 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.000014 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" event={"ID":"e36234f1-e943-4f50-906b-405961fe45dd","Type":"ContainerStarted","Data":"2b886230502248a6954d01675845ed7cfc958280bcba4d79b5c8f3537a634c4d"} Jun 12 21:45:10.465260 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.465217 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:10.465451 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.465271 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:10.465451 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.465407 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:10.465566 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.465475 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:12.465452637 +0000 UTC m=+4.981592521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:10.465979 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.465958 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:10.466083 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.466018 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:12.466001783 +0000 UTC m=+4.982141638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:10.666620 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.666588 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:10.666789 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.666752 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:10.666789 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.666779 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:10.666789 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.666792 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:10.666958 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.666857 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:12.666836015 +0000 UTC m=+5.182975871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:10.885869 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.885739 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:40:08 +0000 UTC" deadline="2028-02-26 18:03:42.698530068 +0000 UTC" Jun 12 21:45:10.885869 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.885808 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14972h18m31.812727045s" Jun 12 21:45:10.908545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.908000 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:10.908545 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:10.908151 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:10.949542 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:10.949278 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:45:11.907034 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:11.907008 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:11.907606 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:11.907165 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:11.907606 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:11.907572 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:11.907726 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:11.907678 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:12.484190 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:12.484249 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.484428 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.484490 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:16.484471792 +0000 UTC m=+9.000611631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.484581 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:12.485029 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.484641 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:16.484605376 +0000 UTC m=+9.000745218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:12.685967 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:12.685931 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:12.686128 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.686098 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:12.686128 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.686124 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:12.686257 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.686138 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:12.686257 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.686200 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:16.68618261 +0000 UTC m=+9.202322450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:12.908070 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:12.907717 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:12.908070 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:12.907847 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:13.908104 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:13.907675 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:13.908104 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:13.907835 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:13.908534 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:13.907674 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:13.908534 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:13.908312 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:14.907598 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:14.907564 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:14.907757 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:14.907697 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:15.907552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:15.907508 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:15.907963 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:15.907634 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:15.907963 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:15.907956 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:15.908080 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:15.908059 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:16.517012 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:16.516978 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:16.517205 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:16.517038 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:16.517205 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.517196 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:16.517390 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.517258 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:24.517239092 +0000 UTC m=+17.033378936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:16.517390 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.517361 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:16.517506 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.517405 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:24.517391651 +0000 UTC m=+17.033531502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:16.719577 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:16.719543 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:16.719767 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.719732 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:16.719767 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.719752 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:16.719767 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.719766 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:16.719904 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.719825 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:24.719806663 +0000 UTC m=+17.235946506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:16.908271 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:16.907908 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:16.908271 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:16.908029 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:17.907958 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:17.907512 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:17.911591 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:17.909536 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:17.911591 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:17.910000 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:17.911591 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:17.910137 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:18.907411 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:18.907379 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:18.907590 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:18.907505 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:19.907048 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:19.907012 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:19.907438 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:19.907147 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:19.907438 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:19.907200 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:19.907438 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:19.907281 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:20.907778 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:20.907750 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:20.908236 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:20.907875 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:21.907421 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:21.907389 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:21.907421 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:21.907411 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:21.907661 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:21.907521 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:21.907661 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:21.907629 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:22.907918 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:22.907882 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:22.908395 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:22.908004 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:23.907487 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:23.907451 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:23.907675 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:23.907451 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:23.907675 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:23.907599 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:23.907675 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:23.907662 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:24.577363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:24.577300 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:24.577363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:24.577353 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:24.577726 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.577432 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:24.577726 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.577479 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:45:40.577465583 +0000 UTC m=+33.093605421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:24.577726 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.577432 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:24.577726 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.577561 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:40.5775468 +0000 UTC m=+33.093686640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:24.779784 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:24.779754 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:24.779968 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.779945 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:24.779968 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.779967 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:24.780053 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.779978 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:24.780053 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.780030 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:40.78001457 +0000 UTC m=+33.296154428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:24.907596 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:24.907567 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:24.907772 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:24.907671 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:25.908083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:25.908049 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:25.908674 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:25.908210 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:25.908674 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:25.908284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:25.908674 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:25.908390 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:26.907803 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:26.907774 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:26.907981 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:26.907889 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:27.908608 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:27.908578 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:27.909043 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:27.908676 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:27.909043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:27.908734 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:27.909043 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:27.908824 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:28.907314 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:28.907272 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:28.907456 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:28.907429 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:29.054836 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:29.054594 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" event={"ID":"81fc4e7aa9137b7763fe31c6de7fca21","Type":"ContainerStarted","Data":"2cfb86ca752ab8235da8d70951583bf2e66920ea23826c058c0bc10a9943d070"} Jun 12 21:45:29.068463 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:29.068420 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" podStartSLOduration=21.068407444 podStartE2EDuration="21.068407444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:29.067954195 +0000 UTC m=+21.584094053" watchObservedRunningTime="2026-06-12 21:45:29.068407444 +0000 UTC m=+21.584547303" Jun 12 21:45:29.907454 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:29.907428 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:29.907588 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:29.907565 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:29.907637 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:29.907617 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:29.907752 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:29.907732 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:30.059332 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.058616 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-595vf" event={"ID":"05a75ae9-263e-4a70-9bf8-80e4dab0a738","Type":"ContainerStarted","Data":"c58593859db468e9118f073ab52c4359f880ee1d0d63f7204c30857426fc830b"} Jun 12 21:45:30.063956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.063302 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cd89m" event={"ID":"44dbfcfb-7f95-4372-90c3-836dc7b5c429","Type":"ContainerStarted","Data":"c87628f3838db3d5fa3a48cd504fc2775e76ba0ed819b2c37539d0e9b27bc1ab"} Jun 12 21:45:30.066535 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.066516 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:45:30.066866 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.066847 2548 generic.go:356] "Generic (PLEG): container finished" podID="7e49afc2-528d-40c5-ade4-27a997d53787" containerID="6c19a9d3c3e56530f2ba82b5985bde90ee51aaa7262d24cbfb4a1c2fa509e0e7" exitCode=1 Jun 12 21:45:30.066929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.066911 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"9000bb41766970bd65e78d937e86ee4a402e7f34e6c9d3483876582720a15988"} Jun 12 21:45:30.066980 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.066970 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"c524b95a71a4a4952e5fa8c8525f83085a9623e40cd6a55ec1cbe3a07d2fd3ae"} Jun 12 21:45:30.067015 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.067001 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerDied","Data":"6c19a9d3c3e56530f2ba82b5985bde90ee51aaa7262d24cbfb4a1c2fa509e0e7"} Jun 12 21:45:30.067053 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.067038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"55fadcb6e2c8cccb32439d0a49bcf428417724ccd25042ad30f5ac6ccad8cd49"} Jun 12 21:45:30.078634 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.078594 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-595vf" podStartSLOduration=2.399160952 podStartE2EDuration="22.078574862s" totalImagesPullingTime="19.67941391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:30.078191993 +0000 UTC m=+22.594331851" watchObservedRunningTime="2026-06-12 21:45:30.078574862 +0000 UTC m=+22.594714726" Jun 12 21:45:30.096228 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.095672 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cd89m" podStartSLOduration=2.443331742 podStartE2EDuration="22.095653378s" totalImagesPullingTime="19.652321636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:30.094917387 +0000 UTC m=+22.611057247" watchObservedRunningTime="2026-06-12 21:45:30.095653378 +0000 UTC m=+22.611793438" Jun 12 21:45:30.907547 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:30.907513 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:30.907742 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:30.907642 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:31.069896 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.069857 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qf89h" event={"ID":"2433ca0c-1727-45c6-ad10-ac5344109b2f","Type":"ContainerStarted","Data":"5b4aeaeaf8662cea3ae82913bb54b790ecb66bd232f3ffe2e41a663e4d87aabe"} Jun 12 21:45:31.071305 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.071283 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="a335f666f0321fc71d01b084c28078663b4bc9ed2e644f034180a6b39a6a98f3" exitCode=0 Jun 12 21:45:31.071406 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.071356 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"a335f666f0321fc71d01b084c28078663b4bc9ed2e644f034180a6b39a6a98f3"} Jun 12 21:45:31.072888 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.072865 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" event={"ID":"e36234f1-e943-4f50-906b-405961fe45dd","Type":"ContainerStarted","Data":"eb644626b6d9d9efb665686523345378d62d5854af11467327cb79fd97d54f29"} Jun 12 21:45:31.078061 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.075928 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:45:31.078544 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.078516 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"b46198eb645f8de4a6039673e64e637f7f36c804143c44bfee628fc309bbc092"} Jun 12 21:45:31.078624 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.078600 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"37c0ebd38fb91d448a3e08a47208995cd758752a551f8bbdcf638b750a89b788"} Jun 12 21:45:31.080045 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.080022 2548 generic.go:356] "Generic (PLEG): container finished" podID="16fc775950d8357e5c00266372fec2e4" containerID="9c36c5f37a8bb5009fecb13124490faf87b8ad913a728dad8fd4221c62fc3db2" exitCode=0 Jun 12 21:45:31.080157 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.080119 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"16fc775950d8357e5c00266372fec2e4","Type":"ContainerDied","Data":"9c36c5f37a8bb5009fecb13124490faf87b8ad913a728dad8fd4221c62fc3db2"} Jun 12 21:45:31.081461 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.081440 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-djxr8" event={"ID":"1dece1d5-2ffa-4174-b840-d283f95de207","Type":"ContainerStarted","Data":"8a9018e5203f6067d2ec5848c4746474ac01caf5aa6ac6e2cf65f7d39a543f91"} Jun 12 21:45:31.082763 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.082743 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c8bv9" event={"ID":"e65fafc2-56cc-45d8-8a99-d388033f7a9b","Type":"ContainerStarted","Data":"6927ab20f86c556d1b65aa6a75daa859e191022a545226aa5686e75345383369"} Jun 12 21:45:31.084169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.084142 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-chdmg" event={"ID":"5ce4da2c-33c6-4363-85ae-0531965e1c7b","Type":"ContainerStarted","Data":"e842ed2b09babad02b7a2b7cc7f938573207214da8e241913be6eb199582ef5b"} Jun 12 21:45:31.084253 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.084215 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qf89h" podStartSLOduration=3.42891137 podStartE2EDuration="23.084204235s" totalImagesPullingTime="19.655292865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:31.083791532 +0000 UTC m=+23.599931402" watchObservedRunningTime="2026-06-12 21:45:31.084204235 +0000 UTC m=+23.600344094" Jun 12 21:45:31.136333 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.136286 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c8bv9" podStartSLOduration=3.506996389 podStartE2EDuration="23.1362692s" totalImagesPullingTime="19.629272811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:31.136207965 +0000 UTC m=+23.652347825" watchObservedRunningTime="2026-06-12 21:45:31.1362692 +0000 UTC m=+23.652409059" Jun 12 21:45:31.149546 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.149509 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-djxr8" podStartSLOduration=3.526278494 podStartE2EDuration="23.149495211s" totalImagesPullingTime="19.623216717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:31.149246903 +0000 UTC m=+23.665386795" watchObservedRunningTime="2026-06-12 21:45:31.149495211 +0000 UTC m=+23.665635106" Jun 12 21:45:31.164184 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.164144 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-chdmg" podStartSLOduration=3.525389844 podStartE2EDuration="23.164133298s" totalImagesPullingTime="19.638743454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:31.16371002 +0000 UTC m=+23.679849879" watchObservedRunningTime="2026-06-12 21:45:31.164133298 +0000 UTC m=+23.680273157" Jun 12 21:45:31.427397 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.427244 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 21:45:31.907334 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.907303 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:31.907523 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:31.907430 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:31.907951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.907792 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:31.907951 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:31.907913 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:31.923241 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.923142 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T21:45:31.427390427Z","UUID":"13bfb3d3-1dbc-4ede-a6fd-fa3b5a6875e2","Handler":null,"Name":"","Endpoint":""} Jun 12 21:45:31.924867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.924845 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 21:45:31.924978 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:31.924889 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 21:45:32.088593 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:32.088550 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"16fc775950d8357e5c00266372fec2e4","Type":"ContainerStarted","Data":"86de492b73dae7d01248d63f05f87a9d80b10bc7203a485f7584f47446c12abe"} Jun 12 21:45:32.093807 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:32.093772 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" event={"ID":"e36234f1-e943-4f50-906b-405961fe45dd","Type":"ContainerStarted","Data":"688f3a74645c5409b6a58a53126cf20c3c76b0f365afa22a124da438f00b76ef"} Jun 12 21:45:32.907279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:32.907248 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:32.907433 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:32.907350 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:33.097974 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.097934 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" event={"ID":"e36234f1-e943-4f50-906b-405961fe45dd","Type":"ContainerStarted","Data":"754959615b462ac63466afc8ce53ed0c834bf3b343e8270bc4cc55250fdee695"} Jun 12 21:45:33.101693 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.101668 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:45:33.102127 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.102099 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"05c40098052b068b25c4132119c611096dff43028bae832313e898f176912dd6"} Jun 12 21:45:33.120543 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.120495 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgnwf" podStartSLOduration=3.385106731 podStartE2EDuration="25.120481221s" totalImagesPullingTime="21.73537449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:33.120382454 +0000 UTC m=+25.636522316" watchObservedRunningTime="2026-06-12 21:45:33.120481221 +0000 UTC m=+25.636621079" Jun 12 21:45:33.121046 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.121017 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" podStartSLOduration=25.12100986 podStartE2EDuration="25.12100986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:32.102241655 +0000 UTC m=+24.618381513" watchObservedRunningTime="2026-06-12 21:45:33.12100986 +0000 UTC m=+25.637149721" Jun 12 21:45:33.908155 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.908115 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:33.908319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:33.908163 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:33.908319 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:33.908273 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:33.908414 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:33.908385 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:34.907615 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:34.907584 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:34.908191 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:34.907739 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:35.538934 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:35.538635 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:35.539607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:35.539460 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:35.907462 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:35.907382 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:35.907625 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:35.907495 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:35.907625 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:35.907580 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:35.908032 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:35.907664 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:36.109126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.109076 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="b4ebad13569288eb4223e1f7d068da78aef0d1f878cd1cef83eb0c1477d8700e" exitCode=0 Jun 12 21:45:36.109126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.109116 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"b4ebad13569288eb4223e1f7d068da78aef0d1f878cd1cef83eb0c1477d8700e"} Jun 12 21:45:36.112476 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.112451 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:45:36.112823 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.112802 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"f0a0602c0ae3a3aeb765dab5b9c66dd986b013d242c330b74210325532033bba"} Jun 12 21:45:36.113129 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113040 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:36.113129 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113105 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:36.113319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113154 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:36.113319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113196 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:36.113319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113306 2548 scope.go:117] "RemoveContainer" containerID="6c19a9d3c3e56530f2ba82b5985bde90ee51aaa7262d24cbfb4a1c2fa509e0e7" Jun 12 21:45:36.113582 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.113517 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qf89h" Jun 12 21:45:36.129369 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.129351 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:36.130116 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.130078 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:45:36.907077 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:36.907050 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:36.907231 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:36.907190 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:37.116507 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.116439 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="e54ee4d90241123dcbdd911c7654f917541142e742a37e3f65832528d841aacf" exitCode=0 Jun 12 21:45:37.116860 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.116516 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"e54ee4d90241123dcbdd911c7654f917541142e742a37e3f65832528d841aacf"} Jun 12 21:45:37.120132 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.120113 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:45:37.120512 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.120490 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" event={"ID":"7e49afc2-528d-40c5-ade4-27a997d53787","Type":"ContainerStarted","Data":"c9f79fe71296a90b308c98c9e985e8702608e90481d092508e6e8c6003673a2f"} Jun 12 21:45:37.161959 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.161919 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" podStartSLOduration=8.702189092 podStartE2EDuration="29.161906895s" totalImagesPullingTime="20.459717803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:37.161902808 +0000 UTC m=+29.678042700" watchObservedRunningTime="2026-06-12 21:45:37.161906895 +0000 UTC m=+29.678046744" Jun 12 21:45:37.907957 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.907933 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:37.908063 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:37.907996 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:37.908063 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:37.908012 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:37.908160 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:37.908076 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:38.124700 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:38.124674 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="d6cbb0f17be1d57dc0adcbaa050554e58e6f8d723d1218a19695f5a3903129a4" exitCode=0 Jun 12 21:45:38.125039 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:38.124764 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"d6cbb0f17be1d57dc0adcbaa050554e58e6f8d723d1218a19695f5a3903129a4"} Jun 12 21:45:38.907640 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:38.907607 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:38.907790 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:38.907718 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:39.911324 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:39.911294 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:39.911720 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:39.911294 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:39.911720 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:39.911420 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:39.911720 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:39.911453 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:40.601785 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:40.601546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:40.601963 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:40.601811 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:40.601963 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.601703 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:40.601963 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.601917 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs podName:f3a93124-08d7-405c-9530-a95446fc306a nodeName:}" failed. No retries permitted until 2026-06-12 21:46:12.601897981 +0000 UTC m=+65.118037817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs") pod "network-metrics-daemon-m4w6v" (UID: "f3a93124-08d7-405c-9530-a95446fc306a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:45:40.601963 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.601935 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:40.602163 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.601982 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret podName:74f3dc65-ce74-40e7-93cd-cca202bd7d3e nodeName:}" failed. No retries permitted until 2026-06-12 21:46:12.601967548 +0000 UTC m=+65.118107391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret") pod "global-pull-secret-syncer-9qtbs" (UID: "74f3dc65-ce74-40e7-93cd-cca202bd7d3e") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:45:40.803076 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:40.803045 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:40.803244 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.803200 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:45:40.803244 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.803225 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:45:40.803244 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.803238 2548 projected.go:196] Error preparing data for projected volume kube-api-access-wdq59 for pod openshift-network-diagnostics/network-check-target-ftphq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:40.803395 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.803302 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59 podName:5d0d1d9d-4973-4185-b0fe-7127759201b1 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:12.803283819 +0000 UTC m=+65.319423671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdq59" (UniqueName: "kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59") pod "network-check-target-ftphq" (UID: "5d0d1d9d-4973-4185-b0fe-7127759201b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:45:40.907216 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:40.907188 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:40.907374 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:40.907287 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:41.907262 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:41.907183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:41.907812 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:41.907320 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:41.907812 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:41.907381 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:41.907812 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:41.907484 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:42.907973 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:42.907945 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:42.908330 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:42.908033 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:43.139544 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:43.139506 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerStarted","Data":"d9a4970f6c2fc7b2bab9e736ac4aa35fa6a9f3096783ade1c6cd5ee16759e23b"} Jun 12 21:45:43.907365 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:43.907337 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:43.907365 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:43.907348 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:43.907627 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:43.907458 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:43.907627 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:43.907557 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:44.144279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.144249 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="d9a4970f6c2fc7b2bab9e736ac4aa35fa6a9f3096783ade1c6cd5ee16759e23b" exitCode=0 Jun 12 21:45:44.144835 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.144306 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"d9a4970f6c2fc7b2bab9e736ac4aa35fa6a9f3096783ade1c6cd5ee16759e23b"} Jun 12 21:45:44.173769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.173470 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qtbs"] Jun 12 21:45:44.173769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.173573 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:44.173769 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:44.173669 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:44.178289 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.178206 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftphq"] Jun 12 21:45:44.178390 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.178293 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:44.178390 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:44.178380 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:44.191371 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.191351 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m4w6v"] Jun 12 21:45:44.191591 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:44.191576 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:44.191802 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:44.191780 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:45.149488 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:45.149449 2548 generic.go:356] "Generic (PLEG): container finished" podID="3e3a75f2-e2e1-46ed-b8ed-def392775f38" containerID="35b26ed39154327998e5a6139ce5456123fdc0499d657c94529b9b0238ca940f" exitCode=0 Jun 12 21:45:45.149488 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:45.149488 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerDied","Data":"35b26ed39154327998e5a6139ce5456123fdc0499d657c94529b9b0238ca940f"} Jun 12 21:45:45.907643 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:45.907469 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:45.907815 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:45.907526 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:45.907815 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:45.907525 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:45.907933 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:45.907807 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qtbs" podUID="74f3dc65-ce74-40e7-93cd-cca202bd7d3e" Jun 12 21:45:45.907933 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:45.907712 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftphq" podUID="5d0d1d9d-4973-4185-b0fe-7127759201b1" Jun 12 21:45:45.907933 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:45.907875 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m4w6v" podUID="f3a93124-08d7-405c-9530-a95446fc306a" Jun 12 21:45:46.155449 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:46.155418 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" event={"ID":"3e3a75f2-e2e1-46ed-b8ed-def392775f38","Type":"ContainerStarted","Data":"5286f07b0f92fdf1ac0242ae1fd3aa66372966807a649ad4d91201d1abe8a4f1"} Jun 12 21:45:46.178032 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:46.177956 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xxpfx" podStartSLOduration=7.831444898 podStartE2EDuration="38.17794081s" totalImagesPullingTime="30.346495912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:46.17685574 +0000 UTC m=+38.692995598" watchObservedRunningTime="2026-06-12 21:45:46.17794081 +0000 UTC m=+38.694080670" Jun 12 21:45:47.761235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.761207 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeReady" Jun 12 21:45:47.761565 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.761338 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 21:45:47.806891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.806863 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bz472"] Jun 12 21:45:47.822948 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.822925 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-76wmr"] Jun 12 21:45:47.823137 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.823052 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bz472" Jun 12 21:45:47.826938 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.825759 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 21:45:47.827585 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.827558 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r2s8f\"" Jun 12 21:45:47.827741 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.827723 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 21:45:47.851243 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.851220 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bz472"] Jun 12 21:45:47.851349 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.851259 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76wmr"] Jun 12 21:45:47.851349 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.851278 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-krkmn"] Jun 12 21:45:47.851453 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.851347 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:47.853553 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.853533 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 21:45:47.853681 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.853527 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gg7s4\"" Jun 12 21:45:47.853681 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.853537 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 21:45:47.853681 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.853565 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 21:45:47.868975 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.868957 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krkmn"] Jun 12 21:45:47.869070 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.869056 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:47.871189 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.871172 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 21:45:47.871189 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.871187 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 21:45:47.871476 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.871462 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pdrfr\"" Jun 12 21:45:47.871964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.871950 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 21:45:47.873882 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.873867 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 21:45:47.909993 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.909976 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:45:47.910120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.910075 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:45:47.910310 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.910292 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:45:47.912409 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.912341 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:45:47.912409 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.912381 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:45:47.912536 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.912354 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z4drq\"" Jun 12 21:45:47.912755 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.912739 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:45:47.912821 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.912783 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvq5c\"" Jun 12 21:45:47.913104 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.913075 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:45:47.960129 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960075 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ldw\" (UniqueName: \"kubernetes.io/projected/27c00552-abc1-46cd-a177-6f15ccaea885-kube-api-access-z9ldw\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:47.960129 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960115 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgtw\" (UniqueName: \"kubernetes.io/projected/840f315a-3fdb-4df8-9342-6d0e97a37745-kube-api-access-lpgtw\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:47.960301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960155 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27c00552-abc1-46cd-a177-6f15ccaea885-cert\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:47.960301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960182 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840f315a-3fdb-4df8-9342-6d0e97a37745-metrics-tls\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:47.960301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960205 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fdf42ec-9a26-40db-827a-66ff22d8393c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:47.960301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960261 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840f315a-3fdb-4df8-9342-6d0e97a37745-tmp-dir\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:47.960301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960281 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:47.960562 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960325 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fdf42ec-9a26-40db-827a-66ff22d8393c-data-volume\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:47.960562 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960352 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840f315a-3fdb-4df8-9342-6d0e97a37745-config-volume\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:47.960562 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960377 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fdf42ec-9a26-40db-827a-66ff22d8393c-crio-socket\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:47.960562 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:47.960394 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwjk\" (UniqueName: \"kubernetes.io/projected/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-api-access-qqwjk\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061306 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061275 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ldw\" (UniqueName: \"kubernetes.io/projected/27c00552-abc1-46cd-a177-6f15ccaea885-kube-api-access-z9ldw\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:48.061306 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061308 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgtw\" (UniqueName: \"kubernetes.io/projected/840f315a-3fdb-4df8-9342-6d0e97a37745-kube-api-access-lpgtw\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.061491 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061341 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27c00552-abc1-46cd-a177-6f15ccaea885-cert\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:48.061491 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061386 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840f315a-3fdb-4df8-9342-6d0e97a37745-metrics-tls\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.061491 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061412 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fdf42ec-9a26-40db-827a-66ff22d8393c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061606 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061587 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840f315a-3fdb-4df8-9342-6d0e97a37745-tmp-dir\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.061642 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061622 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061684 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061654 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fdf42ec-9a26-40db-827a-66ff22d8393c-data-volume\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061720 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061685 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840f315a-3fdb-4df8-9342-6d0e97a37745-config-volume\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.061761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061726 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fdf42ec-9a26-40db-827a-66ff22d8393c-crio-socket\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061747 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwjk\" (UniqueName: \"kubernetes.io/projected/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-api-access-qqwjk\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.061943 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.061920 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840f315a-3fdb-4df8-9342-6d0e97a37745-tmp-dir\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.062539 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.062155 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fdf42ec-9a26-40db-827a-66ff22d8393c-data-volume\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.062539 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.062300 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fdf42ec-9a26-40db-827a-66ff22d8393c-crio-socket\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.062539 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.062412 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.062539 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.062412 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/840f315a-3fdb-4df8-9342-6d0e97a37745-config-volume\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.065295 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.065276 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fdf42ec-9a26-40db-827a-66ff22d8393c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.065442 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.065424 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/840f315a-3fdb-4df8-9342-6d0e97a37745-metrics-tls\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.065504 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.065426 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27c00552-abc1-46cd-a177-6f15ccaea885-cert\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:48.076840 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.076816 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ldw\" (UniqueName: \"kubernetes.io/projected/27c00552-abc1-46cd-a177-6f15ccaea885-kube-api-access-z9ldw\") pod \"ingress-canary-76wmr\" (UID: \"27c00552-abc1-46cd-a177-6f15ccaea885\") " pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:48.076949 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.076933 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgtw\" (UniqueName: \"kubernetes.io/projected/840f315a-3fdb-4df8-9342-6d0e97a37745-kube-api-access-lpgtw\") pod \"dns-default-bz472\" (UID: \"840f315a-3fdb-4df8-9342-6d0e97a37745\") " pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.077440 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.077419 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwjk\" (UniqueName: \"kubernetes.io/projected/3fdf42ec-9a26-40db-827a-66ff22d8393c-kube-api-access-qqwjk\") pod \"insights-runtime-extractor-krkmn\" (UID: \"3fdf42ec-9a26-40db-827a-66ff22d8393c\") " pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.135324 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.135304 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bz472" Jun 12 21:45:48.159043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.159023 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76wmr" Jun 12 21:45:48.176372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.176355 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krkmn" Jun 12 21:45:48.356630 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.356602 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76wmr"] Jun 12 21:45:48.359672 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:48.359642 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c00552_abc1_46cd_a177_6f15ccaea885.slice/crio-08d0825787c7469d1b27870723c39979b05b194b8b5347433de20bafc033cb7d WatchSource:0}: Error finding container 08d0825787c7469d1b27870723c39979b05b194b8b5347433de20bafc033cb7d: Status 404 returned error can't find the container with id 08d0825787c7469d1b27870723c39979b05b194b8b5347433de20bafc033cb7d Jun 12 21:45:48.559225 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.559152 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krkmn"] Jun 12 21:45:48.561448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:48.561426 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bz472"] Jun 12 21:45:48.562165 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:48.562139 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdf42ec_9a26_40db_827a_66ff22d8393c.slice/crio-6ffd747416741d1e3136ea86cea1f8fd06cb66b1a14f9dd098b26befcd827542 WatchSource:0}: Error finding container 6ffd747416741d1e3136ea86cea1f8fd06cb66b1a14f9dd098b26befcd827542: Status 404 returned error can't find the container with id 6ffd747416741d1e3136ea86cea1f8fd06cb66b1a14f9dd098b26befcd827542 Jun 12 21:45:48.564483 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:48.564464 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840f315a_3fdb_4df8_9342_6d0e97a37745.slice/crio-f7b5556196d3b7b4dccf5fe9e4397365a7603f9a1290723fdc0dad8ead8a124d WatchSource:0}: Error finding container f7b5556196d3b7b4dccf5fe9e4397365a7603f9a1290723fdc0dad8ead8a124d: Status 404 returned error can't find the container with id f7b5556196d3b7b4dccf5fe9e4397365a7603f9a1290723fdc0dad8ead8a124d Jun 12 21:45:49.165987 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.165952 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76wmr" event={"ID":"27c00552-abc1-46cd-a177-6f15ccaea885","Type":"ContainerStarted","Data":"08d0825787c7469d1b27870723c39979b05b194b8b5347433de20bafc033cb7d"} Jun 12 21:45:49.168125 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.168011 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krkmn" event={"ID":"3fdf42ec-9a26-40db-827a-66ff22d8393c","Type":"ContainerStarted","Data":"6ffd747416741d1e3136ea86cea1f8fd06cb66b1a14f9dd098b26befcd827542"} Jun 12 21:45:49.169678 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.169338 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz472" event={"ID":"840f315a-3fdb-4df8-9342-6d0e97a37745","Type":"ContainerStarted","Data":"f7b5556196d3b7b4dccf5fe9e4397365a7603f9a1290723fdc0dad8ead8a124d"} Jun 12 21:45:49.490360 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.488697 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-rzfvl"] Jun 12 21:45:49.500110 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.499969 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:45:49.504186 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.503455 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 21:45:49.504186 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.503684 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 21:45:49.504186 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.503875 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hlvzb\"" Jun 12 21:45:49.514468 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.513300 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-rzfvl"] Jun 12 21:45:49.674275 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.674132 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2h2p\" (UniqueName: \"kubernetes.io/projected/6b948a6a-8e19-496d-82eb-6482f836890c-kube-api-access-n2h2p\") pod \"downloads-694c955b9-rzfvl\" (UID: \"6b948a6a-8e19-496d-82eb-6482f836890c\") " pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:45:49.775489 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.775314 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2h2p\" (UniqueName: \"kubernetes.io/projected/6b948a6a-8e19-496d-82eb-6482f836890c-kube-api-access-n2h2p\") pod \"downloads-694c955b9-rzfvl\" (UID: \"6b948a6a-8e19-496d-82eb-6482f836890c\") " pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:45:49.791917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.791820 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2h2p\" (UniqueName: \"kubernetes.io/projected/6b948a6a-8e19-496d-82eb-6482f836890c-kube-api-access-n2h2p\") pod \"downloads-694c955b9-rzfvl\" (UID: \"6b948a6a-8e19-496d-82eb-6482f836890c\") " pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:45:49.819818 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:49.819766 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:45:50.001337 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:50.001305 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-rzfvl"] Jun 12 21:45:50.610916 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:50.610878 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b948a6a_8e19_496d_82eb_6482f836890c.slice/crio-944438069aa0caa7855da85fab3103bfcf2fe20590b14de3ee6c68ff38b1ca8a WatchSource:0}: Error finding container 944438069aa0caa7855da85fab3103bfcf2fe20590b14de3ee6c68ff38b1ca8a: Status 404 returned error can't find the container with id 944438069aa0caa7855da85fab3103bfcf2fe20590b14de3ee6c68ff38b1ca8a Jun 12 21:45:51.176214 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:51.176179 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-rzfvl" event={"ID":"6b948a6a-8e19-496d-82eb-6482f836890c","Type":"ContainerStarted","Data":"944438069aa0caa7855da85fab3103bfcf2fe20590b14de3ee6c68ff38b1ca8a"} Jun 12 21:45:54.186320 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.186233 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krkmn" event={"ID":"3fdf42ec-9a26-40db-827a-66ff22d8393c","Type":"ContainerStarted","Data":"ad95b5083af1818683073efdf57bbc57d5b91c86b957a304eb97cc958459d475"} Jun 12 21:45:54.187905 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.187871 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76wmr" event={"ID":"27c00552-abc1-46cd-a177-6f15ccaea885","Type":"ContainerStarted","Data":"5415eb48197dad82aaaa84f4e982f5635634c8af25955ba3495d09ce1296672f"} Jun 12 21:45:54.189769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.189745 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz472" event={"ID":"840f315a-3fdb-4df8-9342-6d0e97a37745","Type":"ContainerStarted","Data":"de5fb096b7908832a699a477047ac0c083528933fb41c338d1b7bd838184d477"} Jun 12 21:45:54.189888 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.189785 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bz472" event={"ID":"840f315a-3fdb-4df8-9342-6d0e97a37745","Type":"ContainerStarted","Data":"f5fa67f22589bf3bb785ed17fa15839272f7ccb0ff902e9973c0828070246916"} Jun 12 21:45:54.189958 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.189898 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bz472" Jun 12 21:45:54.203755 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.203706 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-76wmr" podStartSLOduration=1.94913341 podStartE2EDuration="7.20368938s" totalImagesPullingTime="5.25455597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:54.202649523 +0000 UTC m=+46.718789381" watchObservedRunningTime="2026-06-12 21:45:54.20368938 +0000 UTC m=+46.719829240" Jun 12 21:45:54.219672 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:54.219614 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bz472" podStartSLOduration=2.167744359 podStartE2EDuration="7.219596537s" totalImagesPullingTime="5.051852178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:54.218510835 +0000 UTC m=+46.734650691" watchObservedRunningTime="2026-06-12 21:45:54.219596537 +0000 UTC m=+46.735736396" Jun 12 21:45:55.197811 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:55.197765 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krkmn" event={"ID":"3fdf42ec-9a26-40db-827a-66ff22d8393c","Type":"ContainerStarted","Data":"311ceb32e77eba027ab652fb9ed1b8ab7461b8a02757f042aa25996c34e332cc"} Jun 12 21:45:56.743673 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.743643 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk"] Jun 12 21:45:56.806952 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.806918 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b"] Jun 12 21:45:56.807139 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.807032 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:56.810407 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.810383 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 21:45:56.810525 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.810417 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 21:45:56.811293 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.811169 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9vfn7\"" Jun 12 21:45:56.811293 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.811185 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 21:45:56.811293 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.811223 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 21:45:56.811293 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.811178 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 21:45:56.837482 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.837456 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk"] Jun 12 21:45:56.837610 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.837512 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b"] Jun 12 21:45:56.837669 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.837628 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:56.840424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.839989 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 21:45:56.840424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.840060 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 21:45:56.840424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.840284 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xg2f4\"" Jun 12 21:45:56.840607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.840489 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 21:45:56.933003 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.932969 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:56.933217 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.933009 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2f33be2-6946-4873-ae43-9dfaba607485-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:56.933217 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.933039 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlscc\" (UniqueName: \"kubernetes.io/projected/e2f33be2-6946-4873-ae43-9dfaba607485-kube-api-access-tlscc\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:56.933217 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.933145 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:56.958154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.958122 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rbm8l"] Jun 12 21:45:56.973702 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.973671 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:56.975960 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.975934 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 21:45:56.975960 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.975958 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 21:45:56.976162 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.975975 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dwsn4\"" Jun 12 21:45:56.976316 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:56.976302 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 21:45:57.034500 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034421 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktpx\" (UniqueName: \"kubernetes.io/projected/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-api-access-lktpx\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.034500 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034470 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.034709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034534 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.034709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034578 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2f33be2-6946-4873-ae43-9dfaba607485-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.034709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034604 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlscc\" (UniqueName: \"kubernetes.io/projected/e2f33be2-6946-4873-ae43-9dfaba607485-kube-api-access-tlscc\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.034709 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:57.034657 2548 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 21:45:57.034902 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:57.034721 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls podName:e2f33be2-6946-4873-ae43-9dfaba607485 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:57.534700883 +0000 UTC m=+50.050840720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-rsktk" (UID: "e2f33be2-6946-4873-ae43-9dfaba607485") : secret "openshift-state-metrics-tls" not found Jun 12 21:45:57.034902 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034656 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.034902 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034823 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.034902 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.034902 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034878 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.035127 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.034929 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.035520 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.035488 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2f33be2-6946-4873-ae43-9dfaba607485-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.037459 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.037429 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.044347 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.044324 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlscc\" (UniqueName: \"kubernetes.io/projected/e2f33be2-6946-4873-ae43-9dfaba607485-kube-api-access-tlscc\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.136099 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.136259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136111 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-sys\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-wtmp\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136380 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136312 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-textfile\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136380 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136356 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136423 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7bw\" (UniqueName: \"kubernetes.io/projected/95dfeb5e-b297-4395-8e6b-226939dfe916-kube-api-access-2x7bw\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136448 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-metrics-client-ca\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136600 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136510 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-root\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136600 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136551 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.136600 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136583 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-tls\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.136744 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136613 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.136744 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136672 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lktpx\" (UniqueName: \"kubernetes.io/projected/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-api-access-lktpx\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.136744 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136707 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.136883 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136757 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.137006 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.136976 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.137372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.137349 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.137475 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.137393 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.138774 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.138754 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.139594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.139574 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.144474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.144445 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktpx\" (UniqueName: \"kubernetes.io/projected/fdfc9658-64c2-4e85-a561-b2e3b3e1db0f-kube-api-access-lktpx\") pod \"kube-state-metrics-678bc549d7-4rx7b\" (UID: \"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.148507 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.148486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" Jun 12 21:45:57.237469 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-textfile\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237635 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237635 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237517 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7bw\" (UniqueName: \"kubernetes.io/projected/95dfeb5e-b297-4395-8e6b-226939dfe916-kube-api-access-2x7bw\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237635 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237543 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-metrics-client-ca\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237791 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237665 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237791 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237719 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-root\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237791 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237768 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-tls\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237934 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237807 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-textfile\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237934 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237847 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-sys\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.237934 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237875 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-wtmp\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.238078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.237947 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-sys\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.238078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.238075 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-wtmp\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.238207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.238118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-metrics-client-ca\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.238207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.238182 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.238421 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.238398 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95dfeb5e-b297-4395-8e6b-226939dfe916-root\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.240554 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.240529 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-tls\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.240648 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.240540 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95dfeb5e-b297-4395-8e6b-226939dfe916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.245056 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.245035 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7bw\" (UniqueName: \"kubernetes.io/projected/95dfeb5e-b297-4395-8e6b-226939dfe916-kube-api-access-2x7bw\") pod \"node-exporter-rbm8l\" (UID: \"95dfeb5e-b297-4395-8e6b-226939dfe916\") " pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.284101 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.284059 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbm8l" Jun 12 21:45:57.337580 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:57.337549 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95dfeb5e_b297_4395_8e6b_226939dfe916.slice/crio-729b91db1d8799714f0f99b17d51d3c7aec7182bfec63b29d89d200a59c09bad WatchSource:0}: Error finding container 729b91db1d8799714f0f99b17d51d3c7aec7182bfec63b29d89d200a59c09bad: Status 404 returned error can't find the container with id 729b91db1d8799714f0f99b17d51d3c7aec7182bfec63b29d89d200a59c09bad Jun 12 21:45:57.467393 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.467351 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b"] Jun 12 21:45:57.473647 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:57.473622 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfc9658_64c2_4e85_a561_b2e3b3e1db0f.slice/crio-e6151f8a31b7f917ad52588e523727313ea1422680d753a26feb6e92f1dd7b23 WatchSource:0}: Error finding container e6151f8a31b7f917ad52588e523727313ea1422680d753a26feb6e92f1dd7b23: Status 404 returned error can't find the container with id e6151f8a31b7f917ad52588e523727313ea1422680d753a26feb6e92f1dd7b23 Jun 12 21:45:57.540906 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.540876 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.543452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.543422 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2f33be2-6946-4873-ae43-9dfaba607485-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-rsktk\" (UID: \"e2f33be2-6946-4873-ae43-9dfaba607485\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.719413 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.719381 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" Jun 12 21:45:57.871169 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.871074 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk"] Jun 12 21:45:57.875613 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:57.875575 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f33be2_6946_4873_ae43_9dfaba607485.slice/crio-60d528f23499e3bbcd2ae5aabe63bcd48d1fead0acd8caf14698a3b18dcdcbc4 WatchSource:0}: Error finding container 60d528f23499e3bbcd2ae5aabe63bcd48d1fead0acd8caf14698a3b18dcdcbc4: Status 404 returned error can't find the container with id 60d528f23499e3bbcd2ae5aabe63bcd48d1fead0acd8caf14698a3b18dcdcbc4 Jun 12 21:45:57.903282 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.903198 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:45:57.929655 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.928354 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.930677 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.930539 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 21:45:57.931154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.930866 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 21:45:57.931154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.930871 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 21:45:57.931154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.930878 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p2t66\"" Jun 12 21:45:57.931348 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931321 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 21:45:57.931348 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931326 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 21:45:57.931516 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931498 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 21:45:57.931594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931524 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 21:45:57.931723 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931666 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 21:45:57.931723 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.931712 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 21:45:57.933727 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.933712 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:45:57.944102 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944069 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944262 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944234 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944272 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjh5\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944328 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944395 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944422 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944451 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944478 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944569 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944595 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:57.944767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:57.944622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.009571 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.009476 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:45:58.027754 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.027675 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:45:58.027875 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.027779 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.030034 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.030531 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-96njj\"" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.030869 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.031111 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.031406 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 21:45:58.032400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.031618 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045592 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045624 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045653 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjh5\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045679 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045708 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045763 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.045798 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.047083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.046327 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048134 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.047961 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048134 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048008 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048134 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048036 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048106 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048441 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048479 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048505 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.048552 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048555 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.048921 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.048592 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj479\" (UniqueName: \"kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.051250 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.050821 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.052081 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.051731 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.053153 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:45:58.052609 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle podName:ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f nodeName:}" failed. No retries permitted until 2026-06-12 21:45:58.552588104 +0000 UTC m=+51.068728170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f") : configmap references non-existent config key: ca-bundle.crt Jun 12 21:45:58.054595 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.054496 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.059563 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.059329 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.059687 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.059655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.064448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.060219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.064448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.063358 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.064448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.063724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.067307 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.066909 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.067307 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.067264 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjh5\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.068228 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.068198 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149461 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149590 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149623 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.150353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.149687 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj479\" (UniqueName: \"kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.151031 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.151004 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.151155 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.151004 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.151512 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.151486 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.153616 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.153566 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.153996 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.153917 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.158775 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.158741 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj479\" (UniqueName: \"kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479\") pod \"console-7d5445fd7c-zn8nv\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.209012 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.208957 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" event={"ID":"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f","Type":"ContainerStarted","Data":"e6151f8a31b7f917ad52588e523727313ea1422680d753a26feb6e92f1dd7b23"} Jun 12 21:45:58.211784 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.211709 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krkmn" event={"ID":"3fdf42ec-9a26-40db-827a-66ff22d8393c","Type":"ContainerStarted","Data":"ef667bccf60e0664224eace8f016f44ef52481ceaa04e011bbdc0f09de3fd166"} Jun 12 21:45:58.214120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.213977 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" event={"ID":"e2f33be2-6946-4873-ae43-9dfaba607485","Type":"ContainerStarted","Data":"81e5831547bea74e9823dad5d3e78740b40bb1f77c24c8d41ea6b9f6a40ffc7f"} Jun 12 21:45:58.214120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.214033 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" event={"ID":"e2f33be2-6946-4873-ae43-9dfaba607485","Type":"ContainerStarted","Data":"69f2e7a6d95e1957cf81220fb6713cf4e20ef6217147ddde046d59a4bccdaac2"} Jun 12 21:45:58.214120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.214062 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" event={"ID":"e2f33be2-6946-4873-ae43-9dfaba607485","Type":"ContainerStarted","Data":"60d528f23499e3bbcd2ae5aabe63bcd48d1fead0acd8caf14698a3b18dcdcbc4"} Jun 12 21:45:58.215162 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.215135 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbm8l" event={"ID":"95dfeb5e-b297-4395-8e6b-226939dfe916","Type":"ContainerStarted","Data":"729b91db1d8799714f0f99b17d51d3c7aec7182bfec63b29d89d200a59c09bad"} Jun 12 21:45:58.233631 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.233382 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-krkmn" podStartSLOduration=2.697891625 podStartE2EDuration="11.233364292s" totalImagesPullingTime="8.535472667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:45:58.232217122 +0000 UTC m=+50.748356982" watchObservedRunningTime="2026-06-12 21:45:58.233364292 +0000 UTC m=+50.749504152" Jun 12 21:45:58.384054 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.383792 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:45:58.555366 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.555328 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.556278 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.556247 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.557159 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.557136 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:45:58.752352 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.752304 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:45:58.761659 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:58.761631 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:45:59.284079 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:59.283791 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba395c1a_12c1_4bf6_a9c3_267b58ce5a6f.slice/crio-cab61e0ec8a0fe1f2ea0d1d7808f424deaaa76c4a5a8f371f08c98ab8ba1f386 WatchSource:0}: Error finding container cab61e0ec8a0fe1f2ea0d1d7808f424deaaa76c4a5a8f371f08c98ab8ba1f386: Status 404 returned error can't find the container with id cab61e0ec8a0fe1f2ea0d1d7808f424deaaa76c4a5a8f371f08c98ab8ba1f386 Jun 12 21:45:59.284728 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:45:59.284634 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5398dc95_1717_495f_a751_65c29bd4a4c5.slice/crio-d3695fb0d79860de6622061455d76374a72ec16c68fe8825135a3b9ad91d2eb3 WatchSource:0}: Error finding container d3695fb0d79860de6622061455d76374a72ec16c68fe8825135a3b9ad91d2eb3: Status 404 returned error can't find the container with id d3695fb0d79860de6622061455d76374a72ec16c68fe8825135a3b9ad91d2eb3 Jun 12 21:45:59.889501 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.889475 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-846b945f45-6nrvk"] Jun 12 21:45:59.909360 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.909335 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.912323 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.912299 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 21:45:59.912662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.912631 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 21:45:59.912662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.912633 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 21:45:59.914679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.914277 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xnvbm\"" Jun 12 21:45:59.914679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.914321 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 21:45:59.914679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.914524 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 21:45:59.914679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.914638 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4qgfv4s3u4f5j\"" Jun 12 21:45:59.915021 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.915000 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846b945f45-6nrvk"] Jun 12 21:45:59.972244 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972214 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972344 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972253 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972407 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972386 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972451 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972421 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgqmb\" (UniqueName: \"kubernetes.io/projected/64b524c2-9545-4eb3-a5b2-b6de689da632-kube-api-access-lgqmb\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972506 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972446 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-grpc-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972506 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972471 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972602 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972547 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b524c2-9545-4eb3-a5b2-b6de689da632-metrics-client-ca\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:45:59.972665 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:45:59.972649 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.073679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.073646 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074165 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074028 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074165 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074072 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074318 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074165 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074318 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074192 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgqmb\" (UniqueName: \"kubernetes.io/projected/64b524c2-9545-4eb3-a5b2-b6de689da632-kube-api-access-lgqmb\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074318 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074218 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-grpc-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074318 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074244 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.074318 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074278 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b524c2-9545-4eb3-a5b2-b6de689da632-metrics-client-ca\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.075016 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.074990 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b524c2-9545-4eb3-a5b2-b6de689da632-metrics-client-ca\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.078709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.078682 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.079454 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.079373 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.080604 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.080581 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-grpc-tls\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.080733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.080641 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.081321 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.081295 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.082180 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.082125 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64b524c2-9545-4eb3-a5b2-b6de689da632-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.086587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.086544 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgqmb\" (UniqueName: \"kubernetes.io/projected/64b524c2-9545-4eb3-a5b2-b6de689da632-kube-api-access-lgqmb\") pod \"thanos-querier-846b945f45-6nrvk\" (UID: \"64b524c2-9545-4eb3-a5b2-b6de689da632\") " pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.221221 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.220993 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:00.226122 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.226072 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" event={"ID":"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f","Type":"ContainerStarted","Data":"b2fdfe2de2e926837fc53aa40b2c63b838d6f98d60c3328c7b504003c39c5c00"} Jun 12 21:46:00.226238 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.226188 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" event={"ID":"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f","Type":"ContainerStarted","Data":"3b258858f1afce367b6aaf9e0be31166112de0ca291bdcc479b7e34b84796631"} Jun 12 21:46:00.228190 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.228158 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5445fd7c-zn8nv" event={"ID":"5398dc95-1717-495f-a751-65c29bd4a4c5","Type":"ContainerStarted","Data":"d3695fb0d79860de6622061455d76374a72ec16c68fe8825135a3b9ad91d2eb3"} Jun 12 21:46:00.230225 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.230203 2548 generic.go:356] "Generic (PLEG): container finished" podID="95dfeb5e-b297-4395-8e6b-226939dfe916" containerID="4a64ef160d2b124b261cd4c2d52b5cf4f594d627c96639f0b053e7fd19ccdda0" exitCode=0 Jun 12 21:46:00.230327 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.230280 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbm8l" event={"ID":"95dfeb5e-b297-4395-8e6b-226939dfe916","Type":"ContainerDied","Data":"4a64ef160d2b124b261cd4c2d52b5cf4f594d627c96639f0b053e7fd19ccdda0"} Jun 12 21:46:00.231932 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.231910 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"cab61e0ec8a0fe1f2ea0d1d7808f424deaaa76c4a5a8f371f08c98ab8ba1f386"} Jun 12 21:46:00.428012 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:00.426462 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-846b945f45-6nrvk"] Jun 12 21:46:00.431559 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:46:00.431531 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b524c2_9545_4eb3_a5b2_b6de689da632.slice/crio-2c0b6f082447ac2b7138075f8570a9baf6e4f8930cf4c93fc1870919fb38f72c WatchSource:0}: Error finding container 2c0b6f082447ac2b7138075f8570a9baf6e4f8930cf4c93fc1870919fb38f72c: Status 404 returned error can't find the container with id 2c0b6f082447ac2b7138075f8570a9baf6e4f8930cf4c93fc1870919fb38f72c Jun 12 21:46:01.170917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.170380 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c77794b85-rpj52"] Jun 12 21:46:01.173499 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.173472 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.176227 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.176202 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 21:46:01.176767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.176746 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 21:46:01.177711 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.176994 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vklr2\"" Jun 12 21:46:01.177711 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.177219 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 21:46:01.177711 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.177322 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6jsjujdti92cq\"" Jun 12 21:46:01.177711 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.177444 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 21:46:01.187538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.187480 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c77794b85-rpj52"] Jun 12 21:46:01.239745 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.239705 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" event={"ID":"e2f33be2-6946-4873-ae43-9dfaba607485","Type":"ContainerStarted","Data":"ee3fd8151258ec1fb46f507b5d9cde4bad194b69220031a13bac9150f4a94883"} Jun 12 21:46:01.242443 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.242354 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbm8l" event={"ID":"95dfeb5e-b297-4395-8e6b-226939dfe916","Type":"ContainerStarted","Data":"eb19989b01834c2d7b93bf06abaa69162166e9051e30b354bd98794b38ff1598"} Jun 12 21:46:01.242443 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.242410 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbm8l" event={"ID":"95dfeb5e-b297-4395-8e6b-226939dfe916","Type":"ContainerStarted","Data":"c72ac011a8d2156a92836dc760c4d8f360dabdc6ae6d57665fb6fa0a9a595d4f"} Jun 12 21:46:01.244479 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.244330 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc" exitCode=0 Jun 12 21:46:01.244479 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.244412 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc"} Jun 12 21:46:01.245813 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.245782 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"2c0b6f082447ac2b7138075f8570a9baf6e4f8930cf4c93fc1870919fb38f72c"} Jun 12 21:46:01.248705 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.248644 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" event={"ID":"fdfc9658-64c2-4e85-a561-b2e3b3e1db0f","Type":"ContainerStarted","Data":"a57a6bcc4b023fe1856622622e64e001f9bf48fb6e425a7b9e08c00386597bba"} Jun 12 21:46:01.259160 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.259064 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-rsktk" podStartSLOduration=3.187579272 podStartE2EDuration="5.259046392s" totalImagesPullingTime="2.07146712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:01.25843682 +0000 UTC m=+53.774576680" watchObservedRunningTime="2026-06-12 21:46:01.259046392 +0000 UTC m=+53.775186250" Jun 12 21:46:01.284452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.284392 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rbm8l" podStartSLOduration=2.987551372 podStartE2EDuration="5.284374736s" totalImagesPullingTime="2.156141696s" totalInitContainerRuntime="140.681668ms" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:01.28388539 +0000 UTC m=+53.800025250" watchObservedRunningTime="2026-06-12 21:46:01.284374736 +0000 UTC m=+53.800514595" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286253 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crxr\" (UniqueName: \"kubernetes.io/projected/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-kube-api-access-8crxr\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286553 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-client-certs\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286623 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286677 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-audit-log\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286812 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-tls\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.286991 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-metrics-server-audit-profiles\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.287078 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.287022 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-client-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388051 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-metrics-server-audit-profiles\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388278 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388117 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-client-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388278 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388197 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crxr\" (UniqueName: \"kubernetes.io/projected/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-kube-api-access-8crxr\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388278 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388255 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-client-certs\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388295 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388318 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-audit-log\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.388452 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.388356 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-tls\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.389216 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.389188 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-metrics-server-audit-profiles\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.389496 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.389431 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-audit-log\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.389760 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.389715 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.392321 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.392274 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-tls\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.392906 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.392866 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-secret-metrics-server-client-certs\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.393293 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.393244 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-client-ca-bundle\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.399115 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.399073 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crxr\" (UniqueName: \"kubernetes.io/projected/9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b-kube-api-access-8crxr\") pod \"metrics-server-7c77794b85-rpj52\" (UID: \"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b\") " pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.487363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.487024 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:01.621476 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.619373 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4rx7b" podStartSLOduration=3.59512076 podStartE2EDuration="5.619346022s" totalImagesPullingTime="2.024225262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:01.342507285 +0000 UTC m=+53.858647145" watchObservedRunningTime="2026-06-12 21:46:01.619346022 +0000 UTC m=+54.135485862" Jun 12 21:46:01.621476 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.620070 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-22v7b"] Jun 12 21:46:01.623884 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.623129 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:01.625980 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.625598 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 21:46:01.625980 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.625835 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nr2z7\"" Jun 12 21:46:01.633919 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.633892 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-22v7b"] Jun 12 21:46:01.663175 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.663082 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c77794b85-rpj52"] Jun 12 21:46:01.669368 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:46:01.669342 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1ca726_b9aa_4e62_88a9_9227bc6f1c8b.slice/crio-70be5f0bb26472f078fe21ad633666c9602a3d891b8e645e30bd55df4b73ac77 WatchSource:0}: Error finding container 70be5f0bb26472f078fe21ad633666c9602a3d891b8e645e30bd55df4b73ac77: Status 404 returned error can't find the container with id 70be5f0bb26472f078fe21ad633666c9602a3d891b8e645e30bd55df4b73ac77 Jun 12 21:46:01.691328 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.691134 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kq6g\" (UniqueName: \"kubernetes.io/projected/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-kube-api-access-6kq6g\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:01.691328 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.691219 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:01.792681 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.792597 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kq6g\" (UniqueName: \"kubernetes.io/projected/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-kube-api-access-6kq6g\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:01.792681 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.792680 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:01.792905 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:46:01.792845 2548 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 21:46:01.792963 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:46:01.792910 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert podName:1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:02.292891723 +0000 UTC m=+54.809031564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-22v7b" (UID: "1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7") : secret "monitoring-plugin-cert" not found Jun 12 21:46:01.805936 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:01.805861 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kq6g\" (UniqueName: \"kubernetes.io/projected/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-kube-api-access-6kq6g\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:02.058767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.057071 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-864c446957-qjtm4"] Jun 12 21:46:02.060244 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.059905 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.062647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.062508 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 21:46:02.063061 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.062778 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 21:46:02.063061 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.062898 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 21:46:02.063313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.063225 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vhr8h\"" Jun 12 21:46:02.063613 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.063424 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 21:46:02.063613 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.063449 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 21:46:02.071041 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.071019 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 21:46:02.079850 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.077064 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-864c446957-qjtm4"] Jun 12 21:46:02.096346 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096315 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-federate-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096440 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096392 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-metrics-client-ca\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096486 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096468 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096536 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096511 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-serving-certs-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096587 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096553 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096641 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096595 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096696 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096636 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdjn\" (UniqueName: \"kubernetes.io/projected/bdb6d531-7d4a-4737-9048-57ad70d0be00-kube-api-access-bhdjn\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.096696 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.096674 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.197727 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-federate-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.197810 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-metrics-client-ca\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.197894 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.197939 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-serving-certs-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.197981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.198023 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.198065 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdjn\" (UniqueName: \"kubernetes.io/projected/bdb6d531-7d4a-4737-9048-57ad70d0be00-kube-api-access-bhdjn\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.198121 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.199579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.199178 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.200151 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.199664 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-serving-certs-ca-bundle\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.201501 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.201109 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb6d531-7d4a-4737-9048-57ad70d0be00-metrics-client-ca\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.203049 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.203023 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-telemeter-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.204369 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.204343 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.205311 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.205263 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-federate-client-tls\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.205813 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.205785 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb6d531-7d4a-4737-9048-57ad70d0be00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.212194 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.212165 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdjn\" (UniqueName: \"kubernetes.io/projected/bdb6d531-7d4a-4737-9048-57ad70d0be00-kube-api-access-bhdjn\") pod \"telemeter-client-864c446957-qjtm4\" (UID: \"bdb6d531-7d4a-4737-9048-57ad70d0be00\") " pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.256371 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.256285 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" event={"ID":"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b","Type":"ContainerStarted","Data":"70be5f0bb26472f078fe21ad633666c9602a3d891b8e645e30bd55df4b73ac77"} Jun 12 21:46:02.298971 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.298932 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:02.303715 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.303565 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-22v7b\" (UID: \"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:02.373793 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.373708 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" Jun 12 21:46:02.543574 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:02.543543 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:03.116687 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.116651 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:46:03.123821 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.123791 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.127570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.127548 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 21:46:03.127759 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.127549 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lotalrfhcvo1\"" Jun 12 21:46:03.127898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.127804 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 21:46:03.127898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.127862 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r5j7l\"" Jun 12 21:46:03.127898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.127862 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 21:46:03.128224 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128184 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 21:46:03.128313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128226 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 21:46:03.128313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128269 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 21:46:03.128313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128185 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 21:46:03.128313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128185 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 21:46:03.128513 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128229 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 21:46:03.128513 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128184 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 21:46:03.128684 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128548 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 21:46:03.128769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.128751 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 21:46:03.130388 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.130369 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 21:46:03.132809 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.132639 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 21:46:03.138959 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.138941 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:46:03.207505 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207430 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207505 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207505 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207515 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207564 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207767 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.207822 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207798 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt2sq\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207883 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207911 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207945 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.207973 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.208007 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.208029 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.208055 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.208538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.208149 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309306 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309277 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309306 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309309 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309338 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2sq\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309368 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309395 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309422 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309464 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309492 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309515 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309538 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309553 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309596 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309630 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309694 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309735 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309753 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309785 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.309917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.309809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.310460 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.310107 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.310460 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.310312 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.310460 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.310310 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.310845 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.310724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.311576 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.311547 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.312566 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.312230 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.313544 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.313522 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.313884 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.313856 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.314247 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.314225 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.314634 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.314605 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.314789 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.314764 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.315590 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.315555 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.316414 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.315918 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.316414 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.316124 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.316414 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.316359 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.316630 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.316441 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.316630 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.316506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.317121 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.317049 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.317788 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.317761 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.319158 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.319138 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2sq\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq\") pod \"prometheus-k8s-0\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:03.436455 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:03.436415 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:04.200468 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:04.200437 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bz472" Jun 12 21:46:08.139578 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:08.139548 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trzn4" Jun 12 21:46:12.122108 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.122064 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-864c446957-qjtm4"] Jun 12 21:46:12.397223 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:46:12.397137 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb6d531_7d4a_4737_9048_57ad70d0be00.slice/crio-f008d6f35b5a64b913e7442a2de9b8f29fd79fab9a8c0fbd210ba4daa46a31bf WatchSource:0}: Error finding container f008d6f35b5a64b913e7442a2de9b8f29fd79fab9a8c0fbd210ba4daa46a31bf: Status 404 returned error can't find the container with id f008d6f35b5a64b913e7442a2de9b8f29fd79fab9a8c0fbd210ba4daa46a31bf Jun 12 21:46:12.584022 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.583851 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:46:12.600612 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.599189 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-22v7b"] Jun 12 21:46:12.700901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.700873 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:46:12.701033 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.700937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:46:12.703222 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.703198 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:46:12.703330 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.703198 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:46:12.713397 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.713373 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74f3dc65-ce74-40e7-93cd-cca202bd7d3e-original-pull-secret\") pod \"global-pull-secret-syncer-9qtbs\" (UID: \"74f3dc65-ce74-40e7-93cd-cca202bd7d3e\") " pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:46:12.714385 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.714366 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3a93124-08d7-405c-9530-a95446fc306a-metrics-certs\") pod \"network-metrics-daemon-m4w6v\" (UID: \"f3a93124-08d7-405c-9530-a95446fc306a\") " pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:46:12.828125 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.828066 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qtbs" Jun 12 21:46:12.834767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.834681 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvq5c\"" Jun 12 21:46:12.844769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.842665 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m4w6v" Jun 12 21:46:12.902893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.902741 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:46:12.907466 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.907311 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:46:12.916897 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.915659 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:46:12.932718 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:12.931717 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdq59\" (UniqueName: \"kubernetes.io/projected/5d0d1d9d-4973-4185-b0fe-7127759201b1-kube-api-access-wdq59\") pod \"network-check-target-ftphq\" (UID: \"5d0d1d9d-4973-4185-b0fe-7127759201b1\") " pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:46:13.038153 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.037426 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qtbs"] Jun 12 21:46:13.054507 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.054478 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m4w6v"] Jun 12 21:46:13.058949 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:46:13.058739 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a93124_08d7_405c_9530_a95446fc306a.slice/crio-7afdea2936b70504f10573e4291e93e3f68ac1cceceb1dd2d8b933224817697c WatchSource:0}: Error finding container 7afdea2936b70504f10573e4291e93e3f68ac1cceceb1dd2d8b933224817697c: Status 404 returned error can't find the container with id 7afdea2936b70504f10573e4291e93e3f68ac1cceceb1dd2d8b933224817697c Jun 12 21:46:13.123721 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.123514 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z4drq\"" Jun 12 21:46:13.131800 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.131694 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:46:13.305891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.305794 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5445fd7c-zn8nv" event={"ID":"5398dc95-1717-495f-a751-65c29bd4a4c5","Type":"ContainerStarted","Data":"cf5af74dc7c1db0776cfccab37c5a85521ef05eb7a866a247d617fb5e1b14e63"} Jun 12 21:46:13.307502 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.307462 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qtbs" event={"ID":"74f3dc65-ce74-40e7-93cd-cca202bd7d3e","Type":"ContainerStarted","Data":"1274f2394b7db3a3e617e5a54b0c6a6ec6e0996418587f46865360772e81136d"} Jun 12 21:46:13.310618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.310324 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" exitCode=0 Jun 12 21:46:13.310618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.310395 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} Jun 12 21:46:13.310618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.310452 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"60860bdf1c9a7190fe0a201acce6ed2f35249f279ca73eacff75a0c40d8b084f"} Jun 12 21:46:13.314515 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.314168 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" event={"ID":"bdb6d531-7d4a-4737-9048-57ad70d0be00","Type":"ContainerStarted","Data":"f008d6f35b5a64b913e7442a2de9b8f29fd79fab9a8c0fbd210ba4daa46a31bf"} Jun 12 21:46:13.317231 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.316546 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-rzfvl" event={"ID":"6b948a6a-8e19-496d-82eb-6482f836890c","Type":"ContainerStarted","Data":"b8b7d6a86283cf72f2cff9ff919ae0269fe10c7d287bace7be13c5c7d5ed09b6"} Jun 12 21:46:13.317231 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.316890 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:46:13.321271 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.321216 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftphq"] Jun 12 21:46:13.321927 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.321878 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m4w6v" event={"ID":"f3a93124-08d7-405c-9530-a95446fc306a","Type":"ContainerStarted","Data":"7afdea2936b70504f10573e4291e93e3f68ac1cceceb1dd2d8b933224817697c"} Jun 12 21:46:13.324638 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.324572 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" event={"ID":"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7","Type":"ContainerStarted","Data":"79f964c63f45b6c019b7a8e925487f2c58dd4d2d8c65ecdabbb5ffbd0ee2aedd"} Jun 12 21:46:13.325695 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:46:13.325668 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0d1d9d_4973_4185_b0fe_7127759201b1.slice/crio-cfeb39005562bd05edfb0ea7fac5b69c787fd0ddd75848c4e209502e0858517b WatchSource:0}: Error finding container cfeb39005562bd05edfb0ea7fac5b69c787fd0ddd75848c4e209502e0858517b: Status 404 returned error can't find the container with id cfeb39005562bd05edfb0ea7fac5b69c787fd0ddd75848c4e209502e0858517b Jun 12 21:46:13.334909 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.332054 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-rzfvl" Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.336892 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d5445fd7c-zn8nv" podStartSLOduration=3.8465753449999998 podStartE2EDuration="16.336873527s" totalImagesPullingTime="12.490298182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:13.335389835 +0000 UTC m=+65.851529696" watchObservedRunningTime="2026-06-12 21:46:13.336873527 +0000 UTC m=+65.853013387" Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.337538 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a"} Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.337601 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca"} Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.337643 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b"} Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.337684 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd"} Jun 12 21:46:13.339363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.337722 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005"} Jun 12 21:46:13.342893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.342740 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"0a0e43ecf7bef604014caee8ec5716f46887ef7f947721fdeaf6f6a03f5fc5c5"} Jun 12 21:46:13.342893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.342809 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"2ac3983c6f6a3934a3bd1bef32f320852a44b0b6945b20f122a4055c2f94b269"} Jun 12 21:46:13.342893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.342851 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"240ff52edba955ea650e6c836e8d68ecbec74d0441d5193ce0425b278b6ff9bd"} Jun 12 21:46:13.344927 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.344906 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" event={"ID":"9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b","Type":"ContainerStarted","Data":"1894e5b0ed38f4ff310b82ef86fb049e729cabff4a805b8a0f72ba6d436f81d1"} Jun 12 21:46:13.386989 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.386754 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-rzfvl" podStartSLOduration=2.599624552 podStartE2EDuration="24.386731291s" totalImagesPullingTime="21.787106739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:13.384538155 +0000 UTC m=+65.900678015" watchObservedRunningTime="2026-06-12 21:46:13.386731291 +0000 UTC m=+65.902871154" Jun 12 21:46:13.405542 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:13.405170 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" podStartSLOduration=1.638065037 podStartE2EDuration="12.405151022s" totalImagesPullingTime="10.767085985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:13.403301291 +0000 UTC m=+65.919441150" watchObservedRunningTime="2026-06-12 21:46:13.405151022 +0000 UTC m=+65.921290883" Jun 12 21:46:14.383408 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:14.382879 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftphq" event={"ID":"5d0d1d9d-4973-4185-b0fe-7127759201b1","Type":"ContainerStarted","Data":"cfeb39005562bd05edfb0ea7fac5b69c787fd0ddd75848c4e209502e0858517b"} Jun 12 21:46:18.281484 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:18.281448 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:46:18.384348 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:18.384320 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:46:21.487434 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:21.487402 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:21.487869 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:21.487462 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:24.436677 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.436640 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerStarted","Data":"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6"} Jun 12 21:46:24.438126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.438076 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftphq" event={"ID":"5d0d1d9d-4973-4185-b0fe-7127759201b1","Type":"ContainerStarted","Data":"55b4413e2787ec6c40b80a219bce813172758d817082610a8af555f0779861ef"} Jun 12 21:46:24.438241 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.438149 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:46:24.439418 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.439393 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" event={"ID":"bdb6d531-7d4a-4737-9048-57ad70d0be00","Type":"ContainerStarted","Data":"8d0aa417645d766aef34f253cff1863090873eabb1aa25e252361ddbd5e2634d"} Jun 12 21:46:24.440751 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.440731 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m4w6v" event={"ID":"f3a93124-08d7-405c-9530-a95446fc306a","Type":"ContainerStarted","Data":"eaa164be4643241f01732664859ecfbfac3fc622df3a3cbd5ce7a74f8926dc5d"} Jun 12 21:46:24.442183 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.442158 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" event={"ID":"1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7","Type":"ContainerStarted","Data":"d5d3b191a253df13a9975e07b601013d8712e120cd5500115c3eb2267aaf7c78"} Jun 12 21:46:24.442387 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.442369 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:24.446819 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.446800 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" Jun 12 21:46:24.469448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.469281 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.840890456 podStartE2EDuration="27.469268765s" totalImagesPullingTime="23.610311841s" totalInitContainerRuntime="18.066468ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:24.467026705 +0000 UTC m=+76.983166563" watchObservedRunningTime="2026-06-12 21:46:24.469268765 +0000 UTC m=+76.985408623" Jun 12 21:46:24.486481 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.486440 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ftphq" podStartSLOduration=65.961371302 podStartE2EDuration="1m16.486426995s" totalImagesPullingTime="10.525055693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:24.484358036 +0000 UTC m=+77.000497894" watchObservedRunningTime="2026-06-12 21:46:24.486426995 +0000 UTC m=+77.002566854" Jun 12 21:46:24.499995 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:24.499955 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-22v7b" podStartSLOduration=12.348314947 podStartE2EDuration="23.499940592s" totalImagesPullingTime="11.151625645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:24.499200448 +0000 UTC m=+77.015340318" watchObservedRunningTime="2026-06-12 21:46:24.499940592 +0000 UTC m=+77.016080451" Jun 12 21:46:25.448679 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.448593 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qtbs" event={"ID":"74f3dc65-ce74-40e7-93cd-cca202bd7d3e","Type":"ContainerStarted","Data":"5b88ee614cf4ff3c81d2dc6e7fd4daab9662c303deb8d2675c320be2579ea619"} Jun 12 21:46:25.451920 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.451889 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} Jun 12 21:46:25.452047 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.451952 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} Jun 12 21:46:25.452047 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.451983 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} Jun 12 21:46:25.452047 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.452015 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} Jun 12 21:46:25.452047 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.452046 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} Jun 12 21:46:25.452242 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.452071 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerStarted","Data":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} Jun 12 21:46:25.453961 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.453936 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" event={"ID":"bdb6d531-7d4a-4737-9048-57ad70d0be00","Type":"ContainerStarted","Data":"1675c3b2a596b8be32a53eb2b75c8cb56a1a682a8695013d69f4c27dde91bf09"} Jun 12 21:46:25.454118 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.453978 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" event={"ID":"bdb6d531-7d4a-4737-9048-57ad70d0be00","Type":"ContainerStarted","Data":"3c358f10a448b34fc0a831b76d6ba2b734b59381bc76672e5b240fe17fa45749"} Jun 12 21:46:25.455572 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.455548 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m4w6v" event={"ID":"f3a93124-08d7-405c-9530-a95446fc306a","Type":"ContainerStarted","Data":"d06a8c6a67f17b4ab8ba5c014bf4f1d68ed5eaf6897cf17d0b159e7c8a8a0f38"} Jun 12 21:46:25.458281 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.458259 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"273188f8cf8b3742e85cda06df57f885c42241dd9de00a1d583cfa9ab30c05b6"} Jun 12 21:46:25.458396 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.458324 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"d5fa430b4efc38dd60bf9cc1ea404b57b0f8529b113b2a9369b5ae02ae3c5c0b"} Jun 12 21:46:25.458396 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.458375 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" event={"ID":"64b524c2-9545-4eb3-a5b2-b6de689da632","Type":"ContainerStarted","Data":"4ec1dbb14fa26f7759152f440e811246bd827a172a6b8e9439ef485a2a483d7b"} Jun 12 21:46:25.465336 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.465288 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9qtbs" podStartSLOduration=65.849124308 podStartE2EDuration="1m17.465272076s" totalImagesPullingTime="11.616147768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:25.464205553 +0000 UTC m=+77.980345412" watchObservedRunningTime="2026-06-12 21:46:25.465272076 +0000 UTC m=+77.981411916" Jun 12 21:46:25.494855 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.494812 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-864c446957-qjtm4" podStartSLOduration=12.045669277 podStartE2EDuration="23.494800064s" totalImagesPullingTime="11.449130787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:25.494343986 +0000 UTC m=+78.010483846" watchObservedRunningTime="2026-06-12 21:46:25.494800064 +0000 UTC m=+78.010939924" Jun 12 21:46:25.526573 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.525906 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" podStartSLOduration=3.4377208980000002 podStartE2EDuration="26.525888974s" totalImagesPullingTime="23.088168076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:25.521070883 +0000 UTC m=+78.037210755" watchObservedRunningTime="2026-06-12 21:46:25.525888974 +0000 UTC m=+78.042028837" Jun 12 21:46:25.537386 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.537347 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m4w6v" podStartSLOduration=66.745950473 podStartE2EDuration="1m17.537333439s" totalImagesPullingTime="10.791382966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:25.536168551 +0000 UTC m=+78.052308410" watchObservedRunningTime="2026-06-12 21:46:25.537333439 +0000 UTC m=+78.053473298" Jun 12 21:46:25.571232 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:25.571189 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=11.992518035 podStartE2EDuration="22.571171962s" totalImagesPullingTime="10.546921322s" totalInitContainerRuntime="31.732605ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:46:25.569223908 +0000 UTC m=+78.085363768" watchObservedRunningTime="2026-06-12 21:46:25.571171962 +0000 UTC m=+78.087311824" Jun 12 21:46:26.463688 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:26.463656 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:26.470660 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:26.470632 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-846b945f45-6nrvk" Jun 12 21:46:28.437030 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:28.436995 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:46:41.493060 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:41.493033 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:41.496900 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:41.496876 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c77794b85-rpj52" Jun 12 21:46:43.305077 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.305021 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d5445fd7c-zn8nv" podUID="5398dc95-1717-495f-a751-65c29bd4a4c5" containerName="console" containerID="cri-o://cf5af74dc7c1db0776cfccab37c5a85521ef05eb7a866a247d617fb5e1b14e63" gracePeriod=15 Jun 12 21:46:43.542695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.542669 2548 generic.go:356] "Generic (PLEG): container finished" podID="5398dc95-1717-495f-a751-65c29bd4a4c5" containerID="cf5af74dc7c1db0776cfccab37c5a85521ef05eb7a866a247d617fb5e1b14e63" exitCode=0 Jun 12 21:46:43.542829 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.542719 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5445fd7c-zn8nv" event={"ID":"5398dc95-1717-495f-a751-65c29bd4a4c5","Type":"ContainerDied","Data":"cf5af74dc7c1db0776cfccab37c5a85521ef05eb7a866a247d617fb5e1b14e63"} Jun 12 21:46:43.576823 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.576768 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:46:43.588384 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588365 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588390 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588432 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588480 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588454 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588505 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj479\" (UniqueName: \"kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588520 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca\") pod \"5398dc95-1717-495f-a751-65c29bd4a4c5\" (UID: \"5398dc95-1717-495f-a751-65c29bd4a4c5\") " Jun 12 21:46:43.588864 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588838 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:43.588959 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588933 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config" (OuterVolumeSpecName: "console-config") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:43.589026 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.588969 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:46:43.590693 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.590668 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:46:43.590783 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.590766 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:46:43.590824 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.590802 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479" (OuterVolumeSpecName: "kube-api-access-sj479") pod "5398dc95-1717-495f-a751-65c29bd4a4c5" (UID: "5398dc95-1717-495f-a751-65c29bd4a4c5"). InnerVolumeSpecName "kube-api-access-sj479". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:46:43.689570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689547 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj479\" (UniqueName: \"kubernetes.io/projected/5398dc95-1717-495f-a751-65c29bd4a4c5-kube-api-access-sj479\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:43.689570 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689568 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-service-ca\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:43.689704 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689576 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-serving-cert\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:43.689704 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689586 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5398dc95-1717-495f-a751-65c29bd4a4c5-console-oauth-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:43.689704 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689594 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-oauth-serving-cert\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:43.689704 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:43.689602 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5398dc95-1717-495f-a751-65c29bd4a4c5-console-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:46:44.547780 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:44.547754 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5445fd7c-zn8nv" Jun 12 21:46:44.548185 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:44.547752 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5445fd7c-zn8nv" event={"ID":"5398dc95-1717-495f-a751-65c29bd4a4c5","Type":"ContainerDied","Data":"d3695fb0d79860de6622061455d76374a72ec16c68fe8825135a3b9ad91d2eb3"} Jun 12 21:46:44.548185 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:44.547911 2548 scope.go:117] "RemoveContainer" containerID="cf5af74dc7c1db0776cfccab37c5a85521ef05eb7a866a247d617fb5e1b14e63" Jun 12 21:46:44.564325 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:44.564294 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:46:44.568767 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:44.568746 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d5445fd7c-zn8nv"] Jun 12 21:46:45.912858 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:45.912826 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5398dc95-1717-495f-a751-65c29bd4a4c5" path="/var/lib/kubelet/pods/5398dc95-1717-495f-a751-65c29bd4a4c5/volumes" Jun 12 21:46:55.460374 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:46:55.460344 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ftphq" Jun 12 21:47:23.180105 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:23.180043 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:23.199054 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:23.199022 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:23.452434 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:23.452365 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:37.257732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.257695 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258001 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="alertmanager" containerID="cri-o://63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005" gracePeriod=120 Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258067 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-metric" containerID="cri-o://633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a" gracePeriod=120 Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258125 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="prom-label-proxy" containerID="cri-o://f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6" gracePeriod=120 Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258152 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-web" containerID="cri-o://3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b" gracePeriod=120 Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258166 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy" containerID="cri-o://1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca" gracePeriod=120 Jun 12 21:47:37.258294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.258213 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="config-reloader" containerID="cri-o://37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd" gracePeriod=120 Jun 12 21:47:37.758450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758413 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6" exitCode=0 Jun 12 21:47:37.758450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758440 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca" exitCode=0 Jun 12 21:47:37.758450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758446 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b" exitCode=0 Jun 12 21:47:37.758450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758452 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd" exitCode=0 Jun 12 21:47:37.758450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758457 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005" exitCode=0 Jun 12 21:47:37.758733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758473 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6"} Jun 12 21:47:37.758733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758565 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca"} Jun 12 21:47:37.758733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758591 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b"} Jun 12 21:47:37.758733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758615 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd"} Jun 12 21:47:37.758733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:37.758638 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005"} Jun 12 21:47:38.504159 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.504132 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.532645 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532620 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532666 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532696 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532732 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532756 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532808 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.532863 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532851 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532901 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532937 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532944 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.532964 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.533022 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxjh5\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.533061 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533191 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.533115 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy\") pod \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\" (UID: \"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f\") " Jun 12 21:47:38.533546 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.533415 2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-main-db\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.534254 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.534178 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:38.534576 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.534546 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:38.537354 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.537306 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:47:38.537950 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.537760 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.538046 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.538008 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.538131 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.538041 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out" (OuterVolumeSpecName: "config-out") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:47:38.539761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.538354 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.539761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.538746 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5" (OuterVolumeSpecName: "kube-api-access-gxjh5") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "kube-api-access-gxjh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:47:38.539918 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.539882 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume" (OuterVolumeSpecName: "config-volume") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.539989 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.539962 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.543592 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.543565 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.552803 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.552780 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config" (OuterVolumeSpecName: "web-config") pod "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" (UID: "ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:38.634297 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634270 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634297 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634295 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-out\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634304 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-tls-assets\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634312 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634322 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-main-tls\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634331 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxjh5\" (UniqueName: \"kubernetes.io/projected/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-kube-api-access-gxjh5\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634339 2548 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-metrics-client-ca\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634347 2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634356 2548 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-cluster-tls-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634365 2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634394 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-web-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.634458 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.634402 2548 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f-config-volume\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:38.764995 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.764965 2548 generic.go:356] "Generic (PLEG): container finished" podID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerID="633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a" exitCode=0 Jun 12 21:47:38.765120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.765011 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a"} Jun 12 21:47:38.765120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.765031 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.765120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.765067 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f","Type":"ContainerDied","Data":"cab61e0ec8a0fe1f2ea0d1d7808f424deaaa76c4a5a8f371f08c98ab8ba1f386"} Jun 12 21:47:38.765120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.765115 2548 scope.go:117] "RemoveContainer" containerID="f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6" Jun 12 21:47:38.772962 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.772945 2548 scope.go:117] "RemoveContainer" containerID="633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a" Jun 12 21:47:38.779872 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.779857 2548 scope.go:117] "RemoveContainer" containerID="1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca" Jun 12 21:47:38.786793 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.786762 2548 scope.go:117] "RemoveContainer" containerID="3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b" Jun 12 21:47:38.788852 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.788828 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:38.792378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.792358 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:38.794598 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.794578 2548 scope.go:117] "RemoveContainer" containerID="37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd" Jun 12 21:47:38.801194 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.801180 2548 scope.go:117] "RemoveContainer" containerID="63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005" Jun 12 21:47:38.807738 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.807723 2548 scope.go:117] "RemoveContainer" containerID="7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc" Jun 12 21:47:38.814583 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.814557 2548 scope.go:117] "RemoveContainer" containerID="f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6" Jun 12 21:47:38.814914 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.814843 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6\": container with ID starting with f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6 not found: ID does not exist" containerID="f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6" Jun 12 21:47:38.814914 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.814879 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6"} err="failed to get container status \"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6\": rpc error: code = NotFound desc = could not find container \"f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6\": container with ID starting with f7f6fea77dd8214a485cfd9873bf366c50cae124af9811760c7a6a41859cfce6 not found: ID does not exist" Jun 12 21:47:38.814914 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.814918 2548 scope.go:117] "RemoveContainer" containerID="633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a" Jun 12 21:47:38.815338 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.815299 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a\": container with ID starting with 633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a not found: ID does not exist" containerID="633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a" Jun 12 21:47:38.815403 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815328 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a"} err="failed to get container status \"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a\": rpc error: code = NotFound desc = could not find container \"633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a\": container with ID starting with 633aa599cb9ae31b56d208998d944d2bbd1431c01e6bff0e46612c1c075f957a not found: ID does not exist" Jun 12 21:47:38.815403 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815349 2548 scope.go:117] "RemoveContainer" containerID="1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca" Jun 12 21:47:38.815662 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.815637 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca\": container with ID starting with 1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca not found: ID does not exist" containerID="1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca" Jun 12 21:47:38.815763 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815669 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca"} err="failed to get container status \"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca\": rpc error: code = NotFound desc = could not find container \"1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca\": container with ID starting with 1e5093dc493542dadd47e73878c92527435e27a253223e4dede0f61d224e67ca not found: ID does not exist" Jun 12 21:47:38.815763 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815691 2548 scope.go:117] "RemoveContainer" containerID="3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b" Jun 12 21:47:38.816022 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.815946 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b\": container with ID starting with 3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b not found: ID does not exist" containerID="3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b" Jun 12 21:47:38.816022 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815974 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b"} err="failed to get container status \"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b\": rpc error: code = NotFound desc = could not find container \"3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b\": container with ID starting with 3fccd881c5ab3a85ba7999fee3f77348b9073c2ae9ef6aafd8cc4580eadb662b not found: ID does not exist" Jun 12 21:47:38.816022 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.815993 2548 scope.go:117] "RemoveContainer" containerID="37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd" Jun 12 21:47:38.816337 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.816315 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd\": container with ID starting with 37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd not found: ID does not exist" containerID="37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd" Jun 12 21:47:38.816398 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.816344 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd"} err="failed to get container status \"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd\": rpc error: code = NotFound desc = could not find container \"37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd\": container with ID starting with 37f4824ebee7a5a44b83afc4b014514c9f4d7ecd1e26e33a012cb552cd3323dd not found: ID does not exist" Jun 12 21:47:38.816398 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.816366 2548 scope.go:117] "RemoveContainer" containerID="63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005" Jun 12 21:47:38.816620 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.816599 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005\": container with ID starting with 63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005 not found: ID does not exist" containerID="63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005" Jun 12 21:47:38.816684 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.816628 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005"} err="failed to get container status \"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005\": rpc error: code = NotFound desc = could not find container \"63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005\": container with ID starting with 63e47b6e93b962c1cb3d05fe828fea7eb5fb0f5eea98744f5eb35d24e287c005 not found: ID does not exist" Jun 12 21:47:38.816684 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.816648 2548 scope.go:117] "RemoveContainer" containerID="7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc" Jun 12 21:47:38.816870 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:38.816853 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc\": container with ID starting with 7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc not found: ID does not exist" containerID="7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc" Jun 12 21:47:38.816912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.816876 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc"} err="failed to get container status \"7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc\": rpc error: code = NotFound desc = could not find container \"7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc\": container with ID starting with 7cbc8f9eb799253aff00dbd13e711b6f8e3ac8474c333a1cc03be52c719a67dc not found: ID does not exist" Jun 12 21:47:38.817301 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817285 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:38.817582 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817569 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="config-reloader" Jun 12 21:47:38.817618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817584 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="config-reloader" Jun 12 21:47:38.817618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817595 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="prom-label-proxy" Jun 12 21:47:38.817618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817602 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="prom-label-proxy" Jun 12 21:47:38.817618 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817614 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5398dc95-1717-495f-a751-65c29bd4a4c5" containerName="console" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817619 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5398dc95-1717-495f-a751-65c29bd4a4c5" containerName="console" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817625 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="alertmanager" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817630 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="alertmanager" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817640 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-metric" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817645 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-metric" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817653 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-web" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817658 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-web" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817666 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="init-config-reloader" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817671 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="init-config-reloader" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817681 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817685 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817726 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-metric" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817733 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="alertmanager" Jun 12 21:47:38.817732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817738 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="config-reloader" Jun 12 21:47:38.818126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817746 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5398dc95-1717-495f-a751-65c29bd4a4c5" containerName="console" Jun 12 21:47:38.818126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817752 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy-web" Jun 12 21:47:38.818126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817758 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="kube-rbac-proxy" Jun 12 21:47:38.818126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.817763 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" containerName="prom-label-proxy" Jun 12 21:47:38.821184 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.821168 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.823537 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.823515 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 21:47:38.823625 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.823584 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 21:47:38.824223 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824207 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 21:47:38.824335 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824315 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p2t66\"" Jun 12 21:47:38.824420 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824367 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 21:47:38.824420 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824375 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 21:47:38.824526 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824437 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 21:47:38.824748 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824728 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 21:47:38.824748 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.824741 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 21:47:38.829245 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.829225 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 21:47:38.836232 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.836212 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:38.936439 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936367 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936439 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936396 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-config-out\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936439 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936431 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936447 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-config-volume\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936492 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936518 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936599 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-web-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936640 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936673 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936691 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:38.936771 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:38.936714 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4bm\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-kube-api-access-9b4bm\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037577 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037608 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037624 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-config-volume\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037651 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037729 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-web-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037754 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.037776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037776 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037797 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037822 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037849 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4bm\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-kube-api-access-9b4bm\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037888 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.037913 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-config-out\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038065 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.038040 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.038611 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.038542 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.040706 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.040677 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.040787 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.040714 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2462c5be-0122-4da7-81ec-2e793484ba56-config-out\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.040826 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.040803 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.040910 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.040889 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-config-volume\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.041173 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.041155 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-web-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.041232 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.041193 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.041279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.041235 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.041314 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.041306 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2462c5be-0122-4da7-81ec-2e793484ba56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.041571 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.041554 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2462c5be-0122-4da7-81ec-2e793484ba56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.042740 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.042723 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.047733 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.047714 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4bm\" (UniqueName: \"kubernetes.io/projected/2462c5be-0122-4da7-81ec-2e793484ba56-kube-api-access-9b4bm\") pod \"alertmanager-main-0\" (UID: \"2462c5be-0122-4da7-81ec-2e793484ba56\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.130117 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.130080 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:47:39.278350 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.278327 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:47:39.280540 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:47:39.280512 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2462c5be_0122_4da7_81ec_2e793484ba56.slice/crio-405835cb441ac9b495e1e934ace90822120012a8ea6fd80b3b06fe6b3fd0ea3e WatchSource:0}: Error finding container 405835cb441ac9b495e1e934ace90822120012a8ea6fd80b3b06fe6b3fd0ea3e: Status 404 returned error can't find the container with id 405835cb441ac9b495e1e934ace90822120012a8ea6fd80b3b06fe6b3fd0ea3e Jun 12 21:47:39.771264 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.771231 2548 generic.go:356] "Generic (PLEG): container finished" podID="2462c5be-0122-4da7-81ec-2e793484ba56" containerID="1b5b24a77cf7b97686e6e7317d4a264315ea252512be1211b5cc18eb41983245" exitCode=0 Jun 12 21:47:39.771622 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.771282 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerDied","Data":"1b5b24a77cf7b97686e6e7317d4a264315ea252512be1211b5cc18eb41983245"} Jun 12 21:47:39.771622 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.771342 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"405835cb441ac9b495e1e934ace90822120012a8ea6fd80b3b06fe6b3fd0ea3e"} Jun 12 21:47:39.912705 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:39.912683 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f" path="/var/lib/kubelet/pods/ba395c1a-12c1-4bf6-a9c3-267b58ce5a6f/volumes" Jun 12 21:47:40.778590 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778548 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"801690d6aa236621773527b8407eb6cf21dd32c4045201a5c5c2b79b080338f5"} Jun 12 21:47:40.778956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778632 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"3d5539aa16e54dada9b1075c1f62422b80820073136ce18fa5e879cd39482203"} Jun 12 21:47:40.778956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778674 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"8eb70fc8ae380a3ff1f1ecc909f3e6296c33ff6ef166f29a32bd8ad806a79d16"} Jun 12 21:47:40.778956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778712 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"1aa43c18b6f79b7188c28c658d3e8bdff0662ce5c565a41d1d83f9a3411cead8"} Jun 12 21:47:40.778956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778747 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"8fb8f18a8756d621e88e5f97c38bf60cd7381edbca7853e8543150c3a6c67367"} Jun 12 21:47:40.778956 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.778784 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2462c5be-0122-4da7-81ec-2e793484ba56","Type":"ContainerStarted","Data":"850abf826028e7c8091a1b53b047df56dce208947831263032f2a996f0e85a25"} Jun 12 21:47:40.802888 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:40.802830 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7880401729999997 podStartE2EDuration="2.802811948s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.771775ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:40.801817567 +0000 UTC m=+153.317957427" watchObservedRunningTime="2026-06-12 21:47:40.802811948 +0000 UTC m=+153.318951815" Jun 12 21:47:41.499144 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499113 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:41.499438 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499395 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="prometheus" containerID="cri-o://56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" gracePeriod=600 Jun 12 21:47:41.499507 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499430 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="thanos-sidecar" containerID="cri-o://8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" gracePeriod=600 Jun 12 21:47:41.499507 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499465 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-web" containerID="cri-o://aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" gracePeriod=600 Jun 12 21:47:41.499626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499488 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="config-reloader" containerID="cri-o://eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" gracePeriod=600 Jun 12 21:47:41.499626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499489 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" gracePeriod=600 Jun 12 21:47:41.499626 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.499423 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy" containerID="cri-o://f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" gracePeriod=600 Jun 12 21:47:41.731951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.731926 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.763015 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.762951 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763015 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763001 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763031 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763060 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763105 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763143 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763185 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763235 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763222 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763249 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763280 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763311 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763344 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763375 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt2sq\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763408 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763438 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763467 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763490 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763536 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763592 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763620 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0\") pod \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\" (UID: \"05f19f51-846e-4a15-ac8c-1d6c961ce82a\") " Jun 12 21:47:41.763891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763813 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.764104 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.763911 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.767200 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.767055 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:47:41.768678 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.768645 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.768791 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.768749 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.769047 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.768979 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.769208 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.769059 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:47:41.769322 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.769146 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.769499 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.769460 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.769648 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.769623 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.769921 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.769898 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.770273 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.770242 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.770376 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.770350 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.770490 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.770462 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:47:41.770745 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.770722 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config" (OuterVolumeSpecName: "config") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.770871 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.770852 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out" (OuterVolumeSpecName: "config-out") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:47:41.771056 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.771031 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.771264 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.771232 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.771345 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.771261 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq" (OuterVolumeSpecName: "kube-api-access-pt2sq") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "kube-api-access-pt2sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:47:41.771490 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.771474 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.780706 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.780684 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config" (OuterVolumeSpecName: "web-config") pod "05f19f51-846e-4a15-ac8c-1d6c961ce82a" (UID: "05f19f51-846e-4a15-ac8c-1d6c961ce82a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:47:41.786787 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786765 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" exitCode=0 Jun 12 21:47:41.786787 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786784 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" exitCode=0 Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786791 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" exitCode=0 Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786797 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" exitCode=0 Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786803 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" exitCode=0 Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786809 2548 generic.go:356] "Generic (PLEG): container finished" podID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" exitCode=0 Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786846 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786909 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} Jun 12 21:47:41.786929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786856 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786939 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786969 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.786995 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.787009 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.787068 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} Jun 12 21:47:41.787195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.787128 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05f19f51-846e-4a15-ac8c-1d6c961ce82a","Type":"ContainerDied","Data":"60860bdf1c9a7190fe0a201acce6ed2f35249f279ca73eacff75a0c40d8b084f"} Jun 12 21:47:41.795908 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.795887 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.806380 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.806362 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.813234 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.813211 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:41.813992 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.813977 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.817067 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.817044 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:41.822219 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.822189 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.828596 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.828579 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.835373 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.835355 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.841802 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.841787 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.842036 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.842019 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.842117 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842042 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.842117 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842058 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.842283 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.842269 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.842321 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842285 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.842321 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842301 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.842501 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.842487 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.842536 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842504 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.842536 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842516 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.842733 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.842718 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.842782 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842735 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.842782 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842748 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.842957 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.842940 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.842993 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842962 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.842993 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.842978 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.843230 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.843215 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.843279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843232 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.843279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843244 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.843421 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:47:41.843405 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.843456 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843424 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.843456 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843438 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.843649 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843631 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.843690 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843658 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.843861 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843846 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.843895 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.843860 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.844045 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844028 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.844097 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844049 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.844295 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844279 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.844295 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844294 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.844470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844456 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.844512 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844469 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.844674 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844656 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.844712 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844674 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.844857 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844841 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.844899 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.844858 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.845043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845024 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.845043 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845040 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.845273 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845254 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.845347 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845275 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.845531 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845513 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.845573 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845535 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.845751 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845734 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.845812 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845752 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.845964 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845947 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.846014 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.845966 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.846179 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846161 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.846179 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846179 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.846409 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846391 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.846457 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846410 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.846643 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846619 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.846707 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846660 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.846867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846851 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.846909 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.846867 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.847052 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847034 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.847109 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847053 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.847322 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847305 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.847380 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847322 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.847607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847581 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.847607 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847608 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.847981 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847943 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.847981 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.847979 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.848332 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848275 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.848332 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848303 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.848670 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848646 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.848755 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848672 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.848955 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848935 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.849009 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.848956 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.849223 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849204 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.849223 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849223 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.849470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849451 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.849537 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849471 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.849641 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849622 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:41.849717 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849698 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.849768 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849718 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.849951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849936 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-web" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849953 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-web" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849961 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849967 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849981 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="thanos-sidecar" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849986 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="thanos-sidecar" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849996 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="prometheus" Jun 12 21:47:41.850004 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850005 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="prometheus" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.849938 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850020 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850013 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-thanos" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850064 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-thanos" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850079 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="init-config-reloader" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850104 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="init-config-reloader" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850124 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="config-reloader" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850131 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="config-reloader" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850214 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-web" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850225 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="prometheus" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850232 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="config-reloader" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850241 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850248 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="thanos-sidecar" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850256 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" containerName="kube-rbac-proxy-thanos" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850268 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.850303 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850283 2548 scope.go:117] "RemoveContainer" containerID="dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850454 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93"} err="failed to get container status \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": rpc error: code = NotFound desc = could not find container \"dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93\": container with ID starting with dcf65620a75e2ef4491ff8653c0d7460d93f08015ecf517c32b649d2b3ea1d93 not found: ID does not exist" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850470 2548 scope.go:117] "RemoveContainer" containerID="f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850639 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27"} err="failed to get container status \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": rpc error: code = NotFound desc = could not find container \"f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27\": container with ID starting with f729e322f3c02985f786f8d21cf40eb60f82fe5a9772a10786bf9597d831ce27 not found: ID does not exist" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850652 2548 scope.go:117] "RemoveContainer" containerID="aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850864 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a"} err="failed to get container status \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": rpc error: code = NotFound desc = could not find container \"aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a\": container with ID starting with aa64fa143e3df784896b57ccdbf070752e17bc66f3a12f5cdd19e708388ed90a not found: ID does not exist" Jun 12 21:47:41.850901 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.850880 2548 scope.go:117] "RemoveContainer" containerID="8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55" Jun 12 21:47:41.851127 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851110 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55"} err="failed to get container status \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": rpc error: code = NotFound desc = could not find container \"8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55\": container with ID starting with 8de4085ded388d9c57fd6da47f2457d43446eb619e7f44ab22db43dfb3d0fc55 not found: ID does not exist" Jun 12 21:47:41.851164 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851127 2548 scope.go:117] "RemoveContainer" containerID="eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306" Jun 12 21:47:41.851326 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851311 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306"} err="failed to get container status \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": rpc error: code = NotFound desc = could not find container \"eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306\": container with ID starting with eed0d83cffdafcb0138573c27f8b3c52d4f49f20f57b9e04e0cf6364c4bee306 not found: ID does not exist" Jun 12 21:47:41.851374 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851326 2548 scope.go:117] "RemoveContainer" containerID="56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f" Jun 12 21:47:41.851545 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851530 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f"} err="failed to get container status \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": rpc error: code = NotFound desc = could not find container \"56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f\": container with ID starting with 56169372f826085a5198ed60c60986c679f6026dba90cb59711696de8cc7439f not found: ID does not exist" Jun 12 21:47:41.851581 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851547 2548 scope.go:117] "RemoveContainer" containerID="04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d" Jun 12 21:47:41.851757 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.851742 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d"} err="failed to get container status \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": rpc error: code = NotFound desc = could not find container \"04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d\": container with ID starting with 04b6050b8a58e277f2fac5be0ce02092902068a6508ecbfbd9a60dec0a41d58d not found: ID does not exist" Jun 12 21:47:41.853951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.853935 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.857891 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.857875 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lotalrfhcvo1\"" Jun 12 21:47:41.858137 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858117 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 21:47:41.858210 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858140 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 21:47:41.858210 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858188 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 21:47:41.858319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858124 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 21:47:41.858319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858207 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 21:47:41.858319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858265 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 21:47:41.858468 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858269 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 21:47:41.858519 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858488 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 21:47:41.858625 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858599 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 21:47:41.858776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858655 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 21:47:41.858776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858676 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 21:47:41.858776 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858702 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 21:47:41.858962 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.858949 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r5j7l\"" Jun 12 21:47:41.862957 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.862935 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 21:47:41.864573 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864551 2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-grpc-tls\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864578 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864594 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864610 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864626 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-web-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864640 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864654 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config-out\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864662 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864665 2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-metrics-client-certs\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864674 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05f19f51-846e-4a15-ac8c-1d6c961ce82a-prometheus-k8s-db\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864683 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864691 2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864700 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864713 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-tls-assets\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864796 2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-config\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864813 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-metrics-client-ca\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864828 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt2sq\" (UniqueName: \"kubernetes.io/projected/05f19f51-846e-4a15-ac8c-1d6c961ce82a-kube-api-access-pt2sq\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864843 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05f19f51-846e-4a15-ac8c-1d6c961ce82a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864857 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.864982 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.864872 2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05f19f51-846e-4a15-ac8c-1d6c961ce82a-secret-kube-rbac-proxy\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:47:41.868639 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.868623 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 21:47:41.884039 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.884012 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:41.913921 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.913892 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f19f51-846e-4a15-ac8c-1d6c961ce82a" path="/var/lib/kubelet/pods/05f19f51-846e-4a15-ac8c-1d6c961ce82a/volumes" Jun 12 21:47:41.965385 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965363 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965389 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965416 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965434 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965470 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965456 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965477 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965494 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965513 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965546 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965594 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965578 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965728 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965603 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965728 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlbpj\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-kube-api-access-wlbpj\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965728 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965655 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965728 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965714 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965736 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965752 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965794 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965837 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965821 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965984 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:41.965984 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:41.965875 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066603 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066532 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066603 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066569 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066603 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066585 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066605 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066628 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066660 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066685 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066718 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066739 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.066805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066765 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.067187 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.066976 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067550 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067595 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067595 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067615 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067654 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067683 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067692 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067724 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067778 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067816 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067842 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlbpj\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-kube-api-access-wlbpj\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.068378 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.067888 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.069006 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.069036 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.069750 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.070122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.070302 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.070912 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.070724 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.071239 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.071216 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.071637 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.071611 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.071834 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.071716 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.071834 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.071738 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-config\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.071986 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.071967 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.072128 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.072030 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.072195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.072167 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.072244 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.072192 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.072537 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.072521 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.078578 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.078561 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlbpj\" (UniqueName: \"kubernetes.io/projected/48cfef32-a9a1-443c-a06d-6a525d1c6e9c-kube-api-access-wlbpj\") pod \"prometheus-k8s-0\" (UID: \"48cfef32-a9a1-443c-a06d-6a525d1c6e9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.163694 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.163669 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:47:42.296077 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.296046 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 21:47:42.299290 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:47:42.299269 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cfef32_a9a1_443c_a06d_6a525d1c6e9c.slice/crio-7ea133e9edd9fcad5204dab03b7b677837a62d52bb24395ea847094c6d957a98 WatchSource:0}: Error finding container 7ea133e9edd9fcad5204dab03b7b677837a62d52bb24395ea847094c6d957a98: Status 404 returned error can't find the container with id 7ea133e9edd9fcad5204dab03b7b677837a62d52bb24395ea847094c6d957a98 Jun 12 21:47:42.798071 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.798037 2548 generic.go:356] "Generic (PLEG): container finished" podID="48cfef32-a9a1-443c-a06d-6a525d1c6e9c" containerID="e1a104b5f93abe53f10de5fe188d175d7cc7d3c368c5ecb1f56d0dc41c979694" exitCode=0 Jun 12 21:47:42.798509 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.798118 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerDied","Data":"e1a104b5f93abe53f10de5fe188d175d7cc7d3c368c5ecb1f56d0dc41c979694"} Jun 12 21:47:42.798509 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:42.798209 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"7ea133e9edd9fcad5204dab03b7b677837a62d52bb24395ea847094c6d957a98"} Jun 12 21:47:43.805659 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805625 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"7eae547f8e8bfd47286523742aced0f0b211e7908ee9433d5686e55264b1d46d"} Jun 12 21:47:43.806005 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805689 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"1e682adeec64338e65279b3b55f01514ea94e5b38b0a0e6540f6333236b29122"} Jun 12 21:47:43.806005 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805724 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"566f46df1d8a2878f53e363f52795f4f5f5346635856019cf06bbf36637d11cb"} Jun 12 21:47:43.806005 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"3dc1c1ef1e0be256bb1bb398ae8deb262afbac5d27cb1ca446c05a3d07f13353"} Jun 12 21:47:43.806005 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805777 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"2efa49cc25b395deae691598621c6f1d7ec1664a6bcbe69cc4f7d708a5fb96d0"} Jun 12 21:47:43.806005 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.805808 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48cfef32-a9a1-443c-a06d-6a525d1c6e9c","Type":"ContainerStarted","Data":"7f7f03e5c4674dc1fb89e295ffd0506870590897eb0d48c2015c93c7e911fae6"} Jun 12 21:47:43.835055 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:43.834986 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.815088616 podStartE2EDuration="2.834964942s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.876326ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:43.832714313 +0000 UTC m=+156.348854174" watchObservedRunningTime="2026-06-12 21:47:43.834964942 +0000 UTC m=+156.351104802" Jun 12 21:47:47.164576 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:47:47.164537 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:48:42.164622 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:48:42.164587 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:48:42.179972 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:48:42.179948 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:48:43.066930 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:48:43.066902 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 21:49:11.198285 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.198253 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw"] Jun 12 21:49:11.201615 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.201598 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.203840 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.203812 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 21:49:11.203943 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.203847 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 21:49:11.204548 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.204526 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p97lz\"" Jun 12 21:49:11.212059 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.212038 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw"] Jun 12 21:49:11.285151 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.285116 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5k7\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-kube-api-access-qj5k7\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.285311 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.285157 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.386170 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.386137 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5k7\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-kube-api-access-qj5k7\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.386170 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.386172 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.394675 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.394640 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5k7\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-kube-api-access-qj5k7\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.395125 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.395076 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72e96348-9935-419a-ae7f-566da31ac229-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fwjnw\" (UID: \"72e96348-9935-419a-ae7f-566da31ac229\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.519374 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.519300 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:11.641327 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:11.641301 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw"] Jun 12 21:49:11.643871 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:49:11.643843 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72e96348_9935_419a_ae7f_566da31ac229.slice/crio-bbdd79d517182c2ec7362cde957b5d8ab75034c9a60124eb5ba4e3b9d225bae4 WatchSource:0}: Error finding container bbdd79d517182c2ec7362cde957b5d8ab75034c9a60124eb5ba4e3b9d225bae4: Status 404 returned error can't find the container with id bbdd79d517182c2ec7362cde957b5d8ab75034c9a60124eb5ba4e3b9d225bae4 Jun 12 21:49:12.164869 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:12.164835 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" event={"ID":"72e96348-9935-419a-ae7f-566da31ac229","Type":"ContainerStarted","Data":"bbdd79d517182c2ec7362cde957b5d8ab75034c9a60124eb5ba4e3b9d225bae4"} Jun 12 21:49:15.183314 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:15.183279 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" event={"ID":"72e96348-9935-419a-ae7f-566da31ac229","Type":"ContainerStarted","Data":"fb78a806b91c467bff2133f23225a202658bbaf62cc3810e4687fed7c50380ae"} Jun 12 21:49:15.183745 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:15.183407 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:15.201357 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:15.201310 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" podStartSLOduration=1.230145931 podStartE2EDuration="4.201294899s" totalImagesPullingTime="2.971148968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:15.200246393 +0000 UTC m=+247.716386254" watchObservedRunningTime="2026-06-12 21:49:15.201294899 +0000 UTC m=+247.717434758" Jun 12 21:49:19.782178 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.782145 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5wjsg"] Jun 12 21:49:19.785638 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.785613 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:19.787609 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.787590 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xslm9\"" Jun 12 21:49:19.792811 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.792786 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5wjsg"] Jun 12 21:49:19.958311 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.958279 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjj72\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-kube-api-access-hjj72\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:19.958460 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:19.958348 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-bound-sa-token\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.059268 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.059200 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjj72\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-kube-api-access-hjj72\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.059268 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.059256 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-bound-sa-token\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.067651 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.067612 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-bound-sa-token\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.067770 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.067708 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjj72\" (UniqueName: \"kubernetes.io/projected/5aac5033-43dc-4924-9ecc-7fb483784e8b-kube-api-access-hjj72\") pod \"cert-manager-59c77684cc-5wjsg\" (UID: \"5aac5033-43dc-4924-9ecc-7fb483784e8b\") " pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.095540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.095518 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5wjsg" Jun 12 21:49:20.218461 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:20.218429 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5wjsg"] Jun 12 21:49:20.221431 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:49:20.221406 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5aac5033_43dc_4924_9ecc_7fb483784e8b.slice/crio-897086a6dae88a384bc8049367212ebba424db98716a6c58839ef7fb9dcb170c WatchSource:0}: Error finding container 897086a6dae88a384bc8049367212ebba424db98716a6c58839ef7fb9dcb170c: Status 404 returned error can't find the container with id 897086a6dae88a384bc8049367212ebba424db98716a6c58839ef7fb9dcb170c Jun 12 21:49:21.189783 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:21.189753 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fwjnw" Jun 12 21:49:21.209204 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:21.209179 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5wjsg" event={"ID":"5aac5033-43dc-4924-9ecc-7fb483784e8b","Type":"ContainerStarted","Data":"d329c717a20ef535be5b458e354686a6e76a4fca077b31334a45c442fdad55a7"} Jun 12 21:49:21.209351 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:21.209212 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5wjsg" event={"ID":"5aac5033-43dc-4924-9ecc-7fb483784e8b","Type":"ContainerStarted","Data":"897086a6dae88a384bc8049367212ebba424db98716a6c58839ef7fb9dcb170c"} Jun 12 21:49:21.223955 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:21.223904 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5wjsg" podStartSLOduration=2.22388642 podStartE2EDuration="2.22388642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:21.223219273 +0000 UTC m=+253.739359135" watchObservedRunningTime="2026-06-12 21:49:21.22388642 +0000 UTC m=+253.740026285" Jun 12 21:49:46.264631 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.264553 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs"] Jun 12 21:49:46.268190 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.268169 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.271259 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.271234 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q98z9\"" Jun 12 21:49:46.271790 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.271776 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 21:49:46.271954 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.271942 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 21:49:46.271994 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.271975 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 21:49:46.272218 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.272206 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 21:49:46.296660 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.296627 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs"] Jun 12 21:49:46.357466 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.357426 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-manifests\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.357466 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.357469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-tmp\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.357661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.357495 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.357661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.357582 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.357661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.357625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcvkt\" (UniqueName: \"kubernetes.io/projected/c561739d-3f6f-442d-90a4-6dc78832ccad-kube-api-access-fcvkt\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458190 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458158 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-manifests\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458190 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458192 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-tmp\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458395 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458222 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458395 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458284 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458395 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458328 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvkt\" (UniqueName: \"kubernetes.io/projected/c561739d-3f6f-442d-90a4-6dc78832ccad-kube-api-access-fcvkt\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.458637 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.458615 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-manifests\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.460417 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.460397 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c561739d-3f6f-442d-90a4-6dc78832ccad-tmp\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.460633 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.460614 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-webhook-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.460694 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.460655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c561739d-3f6f-442d-90a4-6dc78832ccad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.469500 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.469479 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcvkt\" (UniqueName: \"kubernetes.io/projected/c561739d-3f6f-442d-90a4-6dc78832ccad-kube-api-access-fcvkt\") pod \"opendatahub-operator-controller-manager-6565f6c44d-gnvgs\" (UID: \"c561739d-3f6f-442d-90a4-6dc78832ccad\") " pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.580128 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.580053 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:46.712695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:46.712664 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs"] Jun 12 21:49:46.716476 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:49:46.716454 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc561739d_3f6f_442d_90a4_6dc78832ccad.slice/crio-49d6e16bd0c1287086cba69ce0b9d0e83193fca087e6e7b34073df27764afea7 WatchSource:0}: Error finding container 49d6e16bd0c1287086cba69ce0b9d0e83193fca087e6e7b34073df27764afea7: Status 404 returned error can't find the container with id 49d6e16bd0c1287086cba69ce0b9d0e83193fca087e6e7b34073df27764afea7 Jun 12 21:49:47.326886 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:47.326749 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" event={"ID":"c561739d-3f6f-442d-90a4-6dc78832ccad","Type":"ContainerStarted","Data":"49d6e16bd0c1287086cba69ce0b9d0e83193fca087e6e7b34073df27764afea7"} Jun 12 21:49:50.343083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:50.343051 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" event={"ID":"c561739d-3f6f-442d-90a4-6dc78832ccad","Type":"ContainerStarted","Data":"32c92b4697b944fab9346e61bf3cbe4c48e7324c799201345567d3d9df189ba5"} Jun 12 21:49:51.348517 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:51.348480 2548 generic.go:356] "Generic (PLEG): container finished" podID="c561739d-3f6f-442d-90a4-6dc78832ccad" containerID="32c92b4697b944fab9346e61bf3cbe4c48e7324c799201345567d3d9df189ba5" exitCode=0 Jun 12 21:49:51.348959 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:51.348563 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" event={"ID":"c561739d-3f6f-442d-90a4-6dc78832ccad","Type":"ContainerDied","Data":"32c92b4697b944fab9346e61bf3cbe4c48e7324c799201345567d3d9df189ba5"} Jun 12 21:49:52.354867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:52.354829 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" event={"ID":"c561739d-3f6f-442d-90a4-6dc78832ccad","Type":"ContainerStarted","Data":"2dbc63ebf40db30874e58b42ed2361a42685ef5b8558db67bd88e6e39fe43151"} Jun 12 21:49:52.355276 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:52.354997 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:49:52.416564 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:49:52.416500 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" podStartSLOduration=2.359186174 podStartE2EDuration="6.416481197s" totalImagesPullingTime="3.070840195s" totalInitContainerRuntime="986.454828ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:52.414972531 +0000 UTC m=+284.931112389" watchObservedRunningTime="2026-06-12 21:49:52.416481197 +0000 UTC m=+284.932621057" Jun 12 21:50:03.361501 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:03.361470 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6565f6c44d-gnvgs" Jun 12 21:50:07.864518 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:07.864486 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:50:07.864962 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:07.864628 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:50:07.867394 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:07.867377 2548 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 21:50:15.816398 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.816362 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt"] Jun 12 21:50:15.819680 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.819665 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:15.822977 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.822956 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 21:50:15.823761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.823743 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 21:50:15.824042 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.824026 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jpqbp\"" Jun 12 21:50:15.824042 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.824037 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:50:15.824202 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.824037 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 21:50:15.824202 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.824103 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 21:50:15.838659 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.838636 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt"] Jun 12 21:50:15.907732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.907706 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-metrics-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:15.907859 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.907767 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cn2b\" (UniqueName: \"kubernetes.io/projected/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-kube-api-access-4cn2b\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:15.907942 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.907924 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:15.907996 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:15.907958 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-manager-config\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.008530 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.008502 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-metrics-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.008530 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.008537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cn2b\" (UniqueName: \"kubernetes.io/projected/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-kube-api-access-4cn2b\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.008747 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.008614 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.008747 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.008633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-manager-config\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.009322 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.009302 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-manager-config\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.011152 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.011126 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.011326 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.011309 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-metrics-cert\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.018677 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.018652 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cn2b\" (UniqueName: \"kubernetes.io/projected/ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9-kube-api-access-4cn2b\") pod \"lws-controller-manager-5866f54786-kkbtt\" (UID: \"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9\") " pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.128932 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.128910 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:16.260784 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.260760 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt"] Jun 12 21:50:16.263457 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:50:16.263427 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5fc0a1_93de_4aed_b1ca_d2c54a4cc8d9.slice/crio-d29ff03680c61eeb02e74a146d8aee5e75fbede9221c3cc3b6f4865955329bcf WatchSource:0}: Error finding container d29ff03680c61eeb02e74a146d8aee5e75fbede9221c3cc3b6f4865955329bcf: Status 404 returned error can't find the container with id d29ff03680c61eeb02e74a146d8aee5e75fbede9221c3cc3b6f4865955329bcf Jun 12 21:50:16.265421 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.265399 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:50:16.459146 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:16.459063 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" event={"ID":"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9","Type":"ContainerStarted","Data":"d29ff03680c61eeb02e74a146d8aee5e75fbede9221c3cc3b6f4865955329bcf"} Jun 12 21:50:19.476443 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:19.476406 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" event={"ID":"ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9","Type":"ContainerStarted","Data":"54db3edc901846d8a4b0d43f738b1d43bdf038b94db85ff4118f9ba23d03b752"} Jun 12 21:50:19.476834 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:19.476488 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:19.515215 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:19.515169 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" podStartSLOduration=2.11794461 podStartE2EDuration="4.515149363s" totalImagesPullingTime="2.397204753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:19.514502981 +0000 UTC m=+312.030642832" watchObservedRunningTime="2026-06-12 21:50:19.515149363 +0000 UTC m=+312.031289223" Jun 12 21:50:30.483256 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:30.483220 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5866f54786-kkbtt" Jun 12 21:50:42.236170 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.236138 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c8dbcfd65-q49wn"] Jun 12 21:50:42.239505 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.239486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.242059 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.242036 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 21:50:42.242300 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.242286 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f6g5h\"" Jun 12 21:50:42.267699 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.267677 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c8dbcfd65-q49wn"] Jun 12 21:50:42.323663 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.323638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-redirect-config\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.323800 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.323687 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slxk7\" (UniqueName: \"kubernetes.io/projected/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-kube-api-access-slxk7\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.424987 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.424960 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-redirect-config\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.425084 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.425006 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slxk7\" (UniqueName: \"kubernetes.io/projected/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-kube-api-access-slxk7\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.425642 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.425621 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-redirect-config\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.441222 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.441192 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slxk7\" (UniqueName: \"kubernetes.io/projected/1e1f70c6-cba1-4a5b-9b39-37151ac1900e-kube-api-access-slxk7\") pod \"dashboard-redirect-7c8dbcfd65-q49wn\" (UID: \"1e1f70c6-cba1-4a5b-9b39-37151ac1900e\") " pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.549376 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.549292 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" Jun 12 21:50:42.701954 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:42.701918 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c8dbcfd65-q49wn"] Jun 12 21:50:42.704802 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:50:42.704780 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1f70c6_cba1_4a5b_9b39_37151ac1900e.slice/crio-6198ab6528e506f49414a81a847665a089dd5102156fe2499f08728b4394b969 WatchSource:0}: Error finding container 6198ab6528e506f49414a81a847665a089dd5102156fe2499f08728b4394b969: Status 404 returned error can't find the container with id 6198ab6528e506f49414a81a847665a089dd5102156fe2499f08728b4394b969 Jun 12 21:50:43.585358 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:43.585323 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" event={"ID":"1e1f70c6-cba1-4a5b-9b39-37151ac1900e","Type":"ContainerStarted","Data":"6198ab6528e506f49414a81a847665a089dd5102156fe2499f08728b4394b969"} Jun 12 21:50:49.613739 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:49.613707 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" event={"ID":"1e1f70c6-cba1-4a5b-9b39-37151ac1900e","Type":"ContainerStarted","Data":"e7b4638e62e92262611dbceb19be01ff769c06d22eac6351b95b537128c66791"} Jun 12 21:50:49.632538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:49.632493 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c8dbcfd65-q49wn" podStartSLOduration=1.061592867 podStartE2EDuration="7.632479196s" totalImagesPullingTime="6.570886329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:50:49.630228176 +0000 UTC m=+342.146368036" watchObservedRunningTime="2026-06-12 21:50:49.632479196 +0000 UTC m=+342.148619054" Jun 12 21:50:57.207113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.207003 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f"] Jun 12 21:50:57.210578 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.210556 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.213834 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.213813 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 21:50:57.213957 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.213851 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 21:50:57.213957 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.213880 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 21:50:57.213957 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.213851 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-694pj\"" Jun 12 21:50:57.227885 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.227867 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f"] Jun 12 21:50:57.249001 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.248969 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249137 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249018 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249137 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249046 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbzw6\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-kube-api-access-rbzw6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249254 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249152 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249254 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249205 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249288 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249353 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249332 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249444 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249402 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.249444 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.249432 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350138 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350079 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350138 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350191 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350222 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350279 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350308 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350354 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350624 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350386 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350624 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350414 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbzw6\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-kube-api-access-rbzw6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350624 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350476 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350781 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350636 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350843 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350807 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350866 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.350953 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.350936 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.352593 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.352571 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.352839 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.352820 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.358772 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.358736 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.358870 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.358788 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbzw6\" (UniqueName: \"kubernetes.io/projected/a0ac0773-43ab-4b4a-ba71-cb45f571bdc7-kube-api-access-rbzw6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcb7l6f\" (UID: \"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.521275 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.521200 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:50:57.657056 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:57.657033 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f"] Jun 12 21:50:57.659517 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:50:57.659491 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ac0773_43ab_4b4a_ba71_cb45f571bdc7.slice/crio-1de272c096767605d685180e3116679fa36c57f2371a46d31f48342834966bb3 WatchSource:0}: Error finding container 1de272c096767605d685180e3116679fa36c57f2371a46d31f48342834966bb3: Status 404 returned error can't find the container with id 1de272c096767605d685180e3116679fa36c57f2371a46d31f48342834966bb3 Jun 12 21:50:58.655397 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:50:58.655355 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" event={"ID":"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7","Type":"ContainerStarted","Data":"1de272c096767605d685180e3116679fa36c57f2371a46d31f48342834966bb3"} Jun 12 21:51:00.419780 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:00.419744 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:51:00.420012 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:00.419820 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:51:00.420012 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:00.419850 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:51:00.666172 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:00.666134 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" event={"ID":"a0ac0773-43ab-4b4a-ba71-cb45f571bdc7","Type":"ContainerStarted","Data":"c932f958893c49f304f348f031f79bc76fab8f48e0906843226bbe84f554c0fa"} Jun 12 21:51:00.690653 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:00.690550 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" podStartSLOduration=0.932517047 podStartE2EDuration="3.690529884s" totalImagesPullingTime="2.758012837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:00.687596051 +0000 UTC m=+353.203735910" watchObservedRunningTime="2026-06-12 21:51:00.690529884 +0000 UTC m=+353.206669745" Jun 12 21:51:01.521390 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:01.521360 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:51:01.526346 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:01.526323 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:51:01.671037 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:01.671007 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:51:01.671896 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:01.671879 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcb7l6f" Jun 12 21:51:06.799206 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.799173 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:06.802751 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.802732 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:06.805573 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.805550 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4d4dt\"" Jun 12 21:51:06.805907 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.805885 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 21:51:06.806207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.806186 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 21:51:06.812665 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.812644 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:06.935207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:06.935177 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6645v\" (UniqueName: \"kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v\") pod \"kuadrant-operator-catalog-qc2p6\" (UID: \"91392f11-06d8-45ab-ae33-210178eb7b3e\") " pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:07.035960 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.035930 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6645v\" (UniqueName: \"kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v\") pod \"kuadrant-operator-catalog-qc2p6\" (UID: \"91392f11-06d8-45ab-ae33-210178eb7b3e\") " pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:07.043644 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.043619 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6645v\" (UniqueName: \"kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v\") pod \"kuadrant-operator-catalog-qc2p6\" (UID: \"91392f11-06d8-45ab-ae33-210178eb7b3e\") " pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:07.114316 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.114295 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:07.171739 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.171678 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:07.242469 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.242434 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:07.245393 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:51:07.245365 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91392f11_06d8_45ab_ae33_210178eb7b3e.slice/crio-6737f8355ca08a401d8b56414f0ce5ebbfede7eaff12aa4dac7a2af1f87b6d61 WatchSource:0}: Error finding container 6737f8355ca08a401d8b56414f0ce5ebbfede7eaff12aa4dac7a2af1f87b6d61: Status 404 returned error can't find the container with id 6737f8355ca08a401d8b56414f0ce5ebbfede7eaff12aa4dac7a2af1f87b6d61 Jun 12 21:51:07.381329 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.381249 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kbgk9"] Jun 12 21:51:07.385868 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.385850 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:07.392213 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.392190 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kbgk9"] Jun 12 21:51:07.439189 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.439158 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7lqs\" (UniqueName: \"kubernetes.io/projected/9959a1ee-5c86-4121-8e3c-770e9b13c8d5-kube-api-access-v7lqs\") pod \"kuadrant-operator-catalog-kbgk9\" (UID: \"9959a1ee-5c86-4121-8e3c-770e9b13c8d5\") " pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:07.539925 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.539892 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7lqs\" (UniqueName: \"kubernetes.io/projected/9959a1ee-5c86-4121-8e3c-770e9b13c8d5-kube-api-access-v7lqs\") pod \"kuadrant-operator-catalog-kbgk9\" (UID: \"9959a1ee-5c86-4121-8e3c-770e9b13c8d5\") " pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:07.547634 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.547605 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7lqs\" (UniqueName: \"kubernetes.io/projected/9959a1ee-5c86-4121-8e3c-770e9b13c8d5-kube-api-access-v7lqs\") pod \"kuadrant-operator-catalog-kbgk9\" (UID: \"9959a1ee-5c86-4121-8e3c-770e9b13c8d5\") " pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:07.696528 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.696441 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:07.701788 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.701763 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" event={"ID":"91392f11-06d8-45ab-ae33-210178eb7b3e","Type":"ContainerStarted","Data":"6737f8355ca08a401d8b56414f0ce5ebbfede7eaff12aa4dac7a2af1f87b6d61"} Jun 12 21:51:07.830100 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:07.830059 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kbgk9"] Jun 12 21:51:07.883103 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:51:07.883060 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9959a1ee_5c86_4121_8e3c_770e9b13c8d5.slice/crio-f4eac3f05a33904e86966ad3d20e5e78bc3dd2945c8eb48673ee61ed4d22657a WatchSource:0}: Error finding container f4eac3f05a33904e86966ad3d20e5e78bc3dd2945c8eb48673ee61ed4d22657a: Status 404 returned error can't find the container with id f4eac3f05a33904e86966ad3d20e5e78bc3dd2945c8eb48673ee61ed4d22657a Jun 12 21:51:08.707689 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:08.707653 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" event={"ID":"9959a1ee-5c86-4121-8e3c-770e9b13c8d5","Type":"ContainerStarted","Data":"f4eac3f05a33904e86966ad3d20e5e78bc3dd2945c8eb48673ee61ed4d22657a"} Jun 12 21:51:09.713742 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.713684 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" event={"ID":"91392f11-06d8-45ab-ae33-210178eb7b3e","Type":"ContainerStarted","Data":"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c"} Jun 12 21:51:09.714164 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.713748 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" podUID="91392f11-06d8-45ab-ae33-210178eb7b3e" containerName="registry-server" containerID="cri-o://bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c" gracePeriod=2 Jun 12 21:51:09.715484 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.715445 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" event={"ID":"9959a1ee-5c86-4121-8e3c-770e9b13c8d5","Type":"ContainerStarted","Data":"65b33efe1248d842d71d9b5f8b7725afa47c8e29d5ecf203fa1960bdbed1b019"} Jun 12 21:51:09.730148 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.730103 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" podStartSLOduration=1.378519933 podStartE2EDuration="3.730075427s" totalImagesPullingTime="2.351555494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:09.727893134 +0000 UTC m=+362.244032993" watchObservedRunningTime="2026-06-12 21:51:09.730075427 +0000 UTC m=+362.246215299" Jun 12 21:51:09.743046 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.742986 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" podStartSLOduration=1.026688723 podStartE2EDuration="2.742968954s" totalImagesPullingTime="1.716280231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:09.742740581 +0000 UTC m=+362.258880441" watchObservedRunningTime="2026-06-12 21:51:09.742968954 +0000 UTC m=+362.259108856" Jun 12 21:51:09.951018 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.950998 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qc2p6_91392f11-06d8-45ab-ae33-210178eb7b3e/registry-server/0.log" Jun 12 21:51:09.953381 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:09.953365 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:10.062201 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.062170 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6645v\" (UniqueName: \"kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v\") pod \"91392f11-06d8-45ab-ae33-210178eb7b3e\" (UID: \"91392f11-06d8-45ab-ae33-210178eb7b3e\") " Jun 12 21:51:10.064255 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.064233 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v" (OuterVolumeSpecName: "kube-api-access-6645v") pod "91392f11-06d8-45ab-ae33-210178eb7b3e" (UID: "91392f11-06d8-45ab-ae33-210178eb7b3e"). InnerVolumeSpecName "kube-api-access-6645v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:51:10.162855 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.162784 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6645v\" (UniqueName: \"kubernetes.io/projected/91392f11-06d8-45ab-ae33-210178eb7b3e-kube-api-access-6645v\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:51:10.721350 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721325 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qc2p6_91392f11-06d8-45ab-ae33-210178eb7b3e/registry-server/0.log" Jun 12 21:51:10.721762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721361 2548 generic.go:356] "Generic (PLEG): container finished" podID="91392f11-06d8-45ab-ae33-210178eb7b3e" containerID="bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c" exitCode=1 Jun 12 21:51:10.721762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721422 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" Jun 12 21:51:10.721762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721451 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" event={"ID":"91392f11-06d8-45ab-ae33-210178eb7b3e","Type":"ContainerDied","Data":"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c"} Jun 12 21:51:10.721762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721500 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qc2p6" event={"ID":"91392f11-06d8-45ab-ae33-210178eb7b3e","Type":"ContainerDied","Data":"6737f8355ca08a401d8b56414f0ce5ebbfede7eaff12aa4dac7a2af1f87b6d61"} Jun 12 21:51:10.721762 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.721519 2548 scope.go:117] "RemoveContainer" containerID="bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c" Jun 12 21:51:10.730916 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.730901 2548 scope.go:117] "RemoveContainer" containerID="bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c" Jun 12 21:51:10.731199 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:51:10.731181 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c\": container with ID starting with bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c not found: ID does not exist" containerID="bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c" Jun 12 21:51:10.731268 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.731212 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c"} err="failed to get container status \"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c\": rpc error: code = NotFound desc = could not find container \"bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c\": container with ID starting with bb3ebe372d89fdb7f3d30626a88202fa76cb943f8b73cb21b56737b84c86a69c not found: ID does not exist" Jun 12 21:51:10.742396 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.742376 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:10.744028 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:10.744008 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qc2p6"] Jun 12 21:51:11.918261 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:11.918221 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91392f11-06d8-45ab-ae33-210178eb7b3e" path="/var/lib/kubelet/pods/91392f11-06d8-45ab-ae33-210178eb7b3e/volumes" Jun 12 21:51:17.696777 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:17.696733 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:17.697207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:17.696818 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:17.719048 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:17.719024 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:17.773995 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:17.773972 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kbgk9" Jun 12 21:51:50.185710 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.185673 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88db95576-w2257"] Jun 12 21:51:50.186372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.186241 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91392f11-06d8-45ab-ae33-210178eb7b3e" containerName="registry-server" Jun 12 21:51:50.186372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.186262 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="91392f11-06d8-45ab-ae33-210178eb7b3e" containerName="registry-server" Jun 12 21:51:50.186372 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.186356 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="91392f11-06d8-45ab-ae33-210178eb7b3e" containerName="registry-server" Jun 12 21:51:50.197571 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.197543 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.199898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.199875 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 21:51:50.200556 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.200526 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 21:51:50.200769 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.200750 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 21:51:50.200907 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.200881 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88db95576-w2257"] Jun 12 21:51:50.201396 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.201376 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 21:51:50.201515 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.201376 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-96njj\"" Jun 12 21:51:50.201627 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.201609 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 21:51:50.206332 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.206311 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 21:51:50.302422 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302388 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-service-ca\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302422 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302423 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-trusted-ca-bundle\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302453 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-oauth-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302480 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-console-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302554 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302661 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302612 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx74k\" (UniqueName: \"kubernetes.io/projected/ef2b7dba-3587-4781-a974-106bf67a4c40-kube-api-access-vx74k\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.302820 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.302658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-oauth-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.403845 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.403812 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-service-ca\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.403845 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.403843 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-trusted-ca-bundle\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.403871 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-oauth-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.403906 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-console-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.403983 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404018 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx74k\" (UniqueName: \"kubernetes.io/projected/ef2b7dba-3587-4781-a974-106bf67a4c40-kube-api-access-vx74k\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404054 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-oauth-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404682 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404655 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-console-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404780 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404659 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-service-ca\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.404842 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404806 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-oauth-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.405010 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.404990 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef2b7dba-3587-4781-a974-106bf67a4c40-trusted-ca-bundle\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.406440 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.406420 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-oauth-config\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.406538 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.406520 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef2b7dba-3587-4781-a974-106bf67a4c40-console-serving-cert\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.414770 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.414745 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx74k\" (UniqueName: \"kubernetes.io/projected/ef2b7dba-3587-4781-a974-106bf67a4c40-kube-api-access-vx74k\") pod \"console-88db95576-w2257\" (UID: \"ef2b7dba-3587-4781-a974-106bf67a4c40\") " pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.510114 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.510040 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88db95576-w2257" Jun 12 21:51:50.648868 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.648830 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88db95576-w2257"] Jun 12 21:51:50.651258 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:51:50.651223 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2b7dba_3587_4781_a974_106bf67a4c40.slice/crio-fb26ba7eba55847d93c1f6a45e69ca7941e1a72b08732bbc69b755a3ebe43eaf WatchSource:0}: Error finding container fb26ba7eba55847d93c1f6a45e69ca7941e1a72b08732bbc69b755a3ebe43eaf: Status 404 returned error can't find the container with id fb26ba7eba55847d93c1f6a45e69ca7941e1a72b08732bbc69b755a3ebe43eaf Jun 12 21:51:50.900911 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.900870 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88db95576-w2257" event={"ID":"ef2b7dba-3587-4781-a974-106bf67a4c40","Type":"ContainerStarted","Data":"21dec95f54898619194dd3f20c7f808d9eea5fbb7b0e61906ef629d59a42ffc8"} Jun 12 21:51:50.901109 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.900960 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88db95576-w2257" event={"ID":"ef2b7dba-3587-4781-a974-106bf67a4c40","Type":"ContainerStarted","Data":"fb26ba7eba55847d93c1f6a45e69ca7941e1a72b08732bbc69b755a3ebe43eaf"} Jun 12 21:51:50.937521 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:50.937473 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88db95576-w2257" podStartSLOduration=0.937458562 podStartE2EDuration="937.458562ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:50.936208879 +0000 UTC m=+403.452348738" watchObservedRunningTime="2026-06-12 21:51:50.937458562 +0000 UTC m=+403.453598421" Jun 12 21:51:52.810074 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:52.810038 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv"] Jun 12 21:51:52.813692 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:52.813672 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:52.816099 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:52.816068 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rbhdc\"" Jun 12 21:51:52.834381 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:52.834357 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv"] Jun 12 21:51:52.928392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:52.928350 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknpc\" (UniqueName: \"kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc\") pod \"limitador-operator-controller-manager-859d7b78bd-28wtv\" (UID: \"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:53.029083 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:53.029050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknpc\" (UniqueName: \"kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc\") pod \"limitador-operator-controller-manager-859d7b78bd-28wtv\" (UID: \"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:53.048171 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:53.048146 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknpc\" (UniqueName: \"kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc\") pod \"limitador-operator-controller-manager-859d7b78bd-28wtv\" (UID: \"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:53.124934 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:53.124909 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:53.260195 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:53.260167 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv"] Jun 12 21:51:53.262034 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:51:53.262004 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38ed6b6_08ea_4266_8f4d_cbf03f1f3cf7.slice/crio-a34d447cc6529a4cee3b71427bdad7a6e4d8db84acd8c7ad4358084430c6e569 WatchSource:0}: Error finding container a34d447cc6529a4cee3b71427bdad7a6e4d8db84acd8c7ad4358084430c6e569: Status 404 returned error can't find the container with id a34d447cc6529a4cee3b71427bdad7a6e4d8db84acd8c7ad4358084430c6e569 Jun 12 21:51:53.917696 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:53.917647 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" event={"ID":"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7","Type":"ContainerStarted","Data":"a34d447cc6529a4cee3b71427bdad7a6e4d8db84acd8c7ad4358084430c6e569"} Jun 12 21:51:54.923581 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:54.923556 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" event={"ID":"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7","Type":"ContainerStarted","Data":"52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27"} Jun 12 21:51:54.923867 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:54.923686 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:51:54.983703 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:54.983630 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" podStartSLOduration=1.404381535 podStartE2EDuration="2.983609847s" totalImagesPullingTime="1.579228312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:54.982682465 +0000 UTC m=+407.498822326" watchObservedRunningTime="2026-06-12 21:51:54.983609847 +0000 UTC m=+407.499749707" Jun 12 21:51:56.306127 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.306075 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl"] Jun 12 21:51:56.309667 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.309649 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:56.312320 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.312304 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 21:51:56.312511 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.312498 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kkkvz\"" Jun 12 21:51:56.323223 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.323203 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl"] Jun 12 21:51:56.361154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.361131 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds62z\" (UniqueName: \"kubernetes.io/projected/66fa3d6b-96bc-479f-8e9c-8a9c027017f2-kube-api-access-ds62z\") pod \"dns-operator-controller-manager-864dd78c4c-bxscl\" (UID: \"66fa3d6b-96bc-479f-8e9c-8a9c027017f2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:56.462598 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.462557 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds62z\" (UniqueName: \"kubernetes.io/projected/66fa3d6b-96bc-479f-8e9c-8a9c027017f2-kube-api-access-ds62z\") pod \"dns-operator-controller-manager-864dd78c4c-bxscl\" (UID: \"66fa3d6b-96bc-479f-8e9c-8a9c027017f2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:56.472917 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.472889 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds62z\" (UniqueName: \"kubernetes.io/projected/66fa3d6b-96bc-479f-8e9c-8a9c027017f2-kube-api-access-ds62z\") pod \"dns-operator-controller-manager-864dd78c4c-bxscl\" (UID: \"66fa3d6b-96bc-479f-8e9c-8a9c027017f2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:56.620058 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.620030 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:56.763631 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.763606 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl"] Jun 12 21:51:56.766477 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:51:56.766451 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fa3d6b_96bc_479f_8e9c_8a9c027017f2.slice/crio-16ae0e92b48bcbcddb91dc4702096c89b72c74816bd4d0f90e660eff00e8797f WatchSource:0}: Error finding container 16ae0e92b48bcbcddb91dc4702096c89b72c74816bd4d0f90e660eff00e8797f: Status 404 returned error can't find the container with id 16ae0e92b48bcbcddb91dc4702096c89b72c74816bd4d0f90e660eff00e8797f Jun 12 21:51:56.934609 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:56.934525 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" event={"ID":"66fa3d6b-96bc-479f-8e9c-8a9c027017f2","Type":"ContainerStarted","Data":"16ae0e92b48bcbcddb91dc4702096c89b72c74816bd4d0f90e660eff00e8797f"} Jun 12 21:51:58.945898 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:58.945871 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" event={"ID":"66fa3d6b-96bc-479f-8e9c-8a9c027017f2","Type":"ContainerStarted","Data":"4b755426e77691dcc3e6009e0270cdd8c65d7df3a0dee3aa8415399612c85030"} Jun 12 21:51:58.946202 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:58.945924 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:51:58.971636 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:51:58.971593 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" podStartSLOduration=0.868981773 podStartE2EDuration="2.971578076s" totalImagesPullingTime="2.102596303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:51:58.970883258 +0000 UTC m=+411.487023117" watchObservedRunningTime="2026-06-12 21:51:58.971578076 +0000 UTC m=+411.487717934" Jun 12 21:52:00.288640 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.288607 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm"] Jun 12 21:52:00.292553 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.292530 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:00.296221 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.296201 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lqtg8\"" Jun 12 21:52:00.313582 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.313559 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm"] Jun 12 21:52:00.401097 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.401059 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2kc\" (UniqueName: \"kubernetes.io/projected/73b4d4df-7c7f-441d-bc7a-b109b871472d-kube-api-access-ht2kc\") pod \"authorino-operator-75cc8d5cb7-tzcwm\" (UID: \"73b4d4df-7c7f-441d-bc7a-b109b871472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:00.501986 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.501942 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2kc\" (UniqueName: \"kubernetes.io/projected/73b4d4df-7c7f-441d-bc7a-b109b871472d-kube-api-access-ht2kc\") pod \"authorino-operator-75cc8d5cb7-tzcwm\" (UID: \"73b4d4df-7c7f-441d-bc7a-b109b871472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:00.510914 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.510888 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88db95576-w2257" Jun 12 21:52:00.511069 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.510949 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88db95576-w2257" Jun 12 21:52:00.513536 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.513508 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2kc\" (UniqueName: \"kubernetes.io/projected/73b4d4df-7c7f-441d-bc7a-b109b871472d-kube-api-access-ht2kc\") pod \"authorino-operator-75cc8d5cb7-tzcwm\" (UID: \"73b4d4df-7c7f-441d-bc7a-b109b871472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:00.516619 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.516602 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88db95576-w2257" Jun 12 21:52:00.602805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.602715 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:00.752384 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.752357 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm"] Jun 12 21:52:00.755581 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:52:00.755553 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b4d4df_7c7f_441d_bc7a_b109b871472d.slice/crio-96ebb4f90aac8814819f53ec157ca103c99c90df626af279ec3bc1a35dcfb018 WatchSource:0}: Error finding container 96ebb4f90aac8814819f53ec157ca103c99c90df626af279ec3bc1a35dcfb018: Status 404 returned error can't find the container with id 96ebb4f90aac8814819f53ec157ca103c99c90df626af279ec3bc1a35dcfb018 Jun 12 21:52:00.956239 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.956203 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" event={"ID":"73b4d4df-7c7f-441d-bc7a-b109b871472d","Type":"ContainerStarted","Data":"96ebb4f90aac8814819f53ec157ca103c99c90df626af279ec3bc1a35dcfb018"} Jun 12 21:52:00.960120 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:00.960083 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88db95576-w2257" Jun 12 21:52:02.967738 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:02.967701 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" event={"ID":"73b4d4df-7c7f-441d-bc7a-b109b871472d","Type":"ContainerStarted","Data":"1da665c3bc8fd4f47fabc1b120f03b130f344aa9571ceb1aca90c851e3be092f"} Jun 12 21:52:02.968056 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:02.967954 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:03.019294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:03.019235 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" podStartSLOduration=0.938777631 podStartE2EDuration="3.0192144s" totalImagesPullingTime="2.080436769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:03.017378387 +0000 UTC m=+415.533518246" watchObservedRunningTime="2026-06-12 21:52:03.0192144 +0000 UTC m=+415.535354259" Jun 12 21:52:05.930806 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:05.930772 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:09.952656 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:09.952624 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bxscl" Jun 12 21:52:13.973693 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:13.973666 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tzcwm" Jun 12 21:52:24.107071 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.107033 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.112269 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.112248 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.118660 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.118338 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tmkzz\"" Jun 12 21:52:24.151329 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.151304 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.199338 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.199307 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2x2v\" (UniqueName: \"kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.199455 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.199350 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.300264 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.300238 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.300392 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.300350 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2x2v\" (UniqueName: \"kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.300597 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.300577 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.312207 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.312184 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2x2v\" (UniqueName: \"kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.326132 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.326107 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.326417 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.326401 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:24.469928 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.469905 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.472850 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:52:24.472824 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14797d63_f4a7_4f61_865a_cf525d56c325.slice/crio-faf52d665f1b495e9cf138b72b96709f7f377dbfbbc5e95862f3a3998f22735d WatchSource:0}: Error finding container faf52d665f1b495e9cf138b72b96709f7f377dbfbbc5e95862f3a3998f22735d: Status 404 returned error can't find the container with id faf52d665f1b495e9cf138b72b96709f7f377dbfbbc5e95862f3a3998f22735d Jun 12 21:52:24.641561 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.641487 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.647319 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.647289 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm"] Jun 12 21:52:24.688377 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.688300 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv"] Jun 12 21:52:24.688813 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.688586 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" containerName="manager" containerID="cri-o://52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27" gracePeriod=2 Jun 12 21:52:24.690597 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:24.690558 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-28wtv\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:24.691472 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.691446 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv"] Jun 12 21:52:24.715907 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.715878 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9"] Jun 12 21:52:24.716332 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.716315 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" containerName="manager" Jun 12 21:52:24.716416 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.716334 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" containerName="manager" Jun 12 21:52:24.716469 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.716425 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" containerName="manager" Jun 12 21:52:24.719368 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.719350 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:24.735843 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.735818 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9"] Jun 12 21:52:24.760831 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:24.760794 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-28wtv\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:24.804273 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.804247 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggk5\" (UniqueName: \"kubernetes.io/projected/0eac5b00-da91-4295-a1d3-94def2d96478-kube-api-access-tggk5\") pod \"limitador-operator-controller-manager-859d7b78bd-nmjv9\" (UID: \"0eac5b00-da91-4295-a1d3-94def2d96478\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:24.905614 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.905525 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggk5\" (UniqueName: \"kubernetes.io/projected/0eac5b00-da91-4295-a1d3-94def2d96478-kube-api-access-tggk5\") pod \"limitador-operator-controller-manager-859d7b78bd-nmjv9\" (UID: \"0eac5b00-da91-4295-a1d3-94def2d96478\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:24.916664 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.916639 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggk5\" (UniqueName: \"kubernetes.io/projected/0eac5b00-da91-4295-a1d3-94def2d96478-kube-api-access-tggk5\") pod \"limitador-operator-controller-manager-859d7b78bd-nmjv9\" (UID: \"0eac5b00-da91-4295-a1d3-94def2d96478\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:24.917793 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:24.917770 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:24.920526 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:24.920498 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-28wtv\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:25.077358 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.077322 2548 generic.go:356] "Generic (PLEG): container finished" podID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" containerID="52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27" exitCode=0 Jun 12 21:52:25.077535 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.077392 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:25.077535 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.077423 2548 scope.go:117] "RemoveContainer" containerID="52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27" Jun 12 21:52:25.079714 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:25.079687 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-28wtv\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:25.082299 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.082279 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:25.087393 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.087371 2548 scope.go:117] "RemoveContainer" containerID="52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27" Jun 12 21:52:25.087745 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:25.087715 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27\": container with ID starting with 52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27 not found: ID does not exist" containerID="52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27" Jun 12 21:52:25.087826 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.087754 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27"} err="failed to get container status \"52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27\": rpc error: code = NotFound desc = could not find container \"52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27\": container with ID starting with 52fa21a09d889ab69ace286c52d137b82eaedd4f7015bd00e6693ea918843b27 not found: ID does not exist" Jun 12 21:52:25.107266 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.107237 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mknpc\" (UniqueName: \"kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc\") pod \"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7\" (UID: \"e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7\") " Jun 12 21:52:25.110096 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.110053 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc" (OuterVolumeSpecName: "kube-api-access-mknpc") pod "e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" (UID: "e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7"). InnerVolumeSpecName "kube-api-access-mknpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:52:25.208027 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.207998 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mknpc\" (UniqueName: \"kubernetes.io/projected/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7-kube-api-access-mknpc\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:52:25.247049 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.247000 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9"] Jun 12 21:52:25.248033 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:52:25.248005 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eac5b00_da91_4295_a1d3_94def2d96478.slice/crio-898802c6773f172714c3315a53d1ab7aea7fbba37da78c6c6c974990365b6e2f WatchSource:0}: Error finding container 898802c6773f172714c3315a53d1ab7aea7fbba37da78c6c6c974990365b6e2f: Status 404 returned error can't find the container with id 898802c6773f172714c3315a53d1ab7aea7fbba37da78c6c6c974990365b6e2f Jun 12 21:52:25.391330 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:25.391289 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-28wtv\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-28wtv" Jun 12 21:52:25.914994 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:25.914951 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7" path="/var/lib/kubelet/pods/e38ed6b6-08ea-4266-8f4d-cbf03f1f3cf7/volumes" Jun 12 21:52:26.087204 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:26.087164 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" event={"ID":"0eac5b00-da91-4295-a1d3-94def2d96478","Type":"ContainerStarted","Data":"c67dc3e46c1f92dcfed73040d5e12d8099383f1cea55440be35354e70135bee2"} Jun 12 21:52:26.087362 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:26.087225 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" event={"ID":"0eac5b00-da91-4295-a1d3-94def2d96478","Type":"ContainerStarted","Data":"898802c6773f172714c3315a53d1ab7aea7fbba37da78c6c6c974990365b6e2f"} Jun 12 21:52:26.087362 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:26.087318 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:52:26.120641 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:26.119996 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" podStartSLOduration=2.119977321 podStartE2EDuration="2.119977321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:26.118012007 +0000 UTC m=+438.634151867" watchObservedRunningTime="2026-06-12 21:52:26.119977321 +0000 UTC m=+438.636117181" Jun 12 21:52:28.098759 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.098674 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" containerName="manager" containerID="cri-o://cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c" gracePeriod=2 Jun 12 21:52:28.100650 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:28.100626 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:28.342883 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.342852 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:28.344935 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:28.344914 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:28.434814 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.434790 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2x2v\" (UniqueName: \"kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v\") pod \"14797d63-f4a7-4f61-865a-cf525d56c325\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " Jun 12 21:52:28.434945 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.434859 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume\") pod \"14797d63-f4a7-4f61-865a-cf525d56c325\" (UID: \"14797d63-f4a7-4f61-865a-cf525d56c325\") " Jun 12 21:52:28.435147 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.435126 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14797d63-f4a7-4f61-865a-cf525d56c325" (UID: "14797d63-f4a7-4f61-865a-cf525d56c325"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:52:28.436785 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.436765 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v" (OuterVolumeSpecName: "kube-api-access-b2x2v") pod "14797d63-f4a7-4f61-865a-cf525d56c325" (UID: "14797d63-f4a7-4f61-865a-cf525d56c325"). InnerVolumeSpecName "kube-api-access-b2x2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:52:28.536055 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.536027 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2x2v\" (UniqueName: \"kubernetes.io/projected/14797d63-f4a7-4f61-865a-cf525d56c325-kube-api-access-b2x2v\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:52:28.536055 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:28.536050 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14797d63-f4a7-4f61-865a-cf525d56c325-extensions-socket-volume\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 21:52:29.105019 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.104986 2548 generic.go:356] "Generic (PLEG): container finished" podID="14797d63-f4a7-4f61-865a-cf525d56c325" containerID="cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c" exitCode=2 Jun 12 21:52:29.105486 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.105035 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:29.105486 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.105043 2548 scope.go:117] "RemoveContainer" containerID="cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c" Jun 12 21:52:29.107476 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:29.107450 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:29.115613 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.114582 2548 scope.go:117] "RemoveContainer" containerID="cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c" Jun 12 21:52:29.115613 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:29.115045 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qf2dm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qf2dm" Jun 12 21:52:29.116149 ip-10-0-130-85 kubenswrapper[2548]: E0612 21:52:29.116123 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c\": container with ID starting with cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c not found: ID does not exist" containerID="cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c" Jun 12 21:52:29.116226 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.116159 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c"} err="failed to get container status \"cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c\": rpc error: code = NotFound desc = could not find container \"cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c\": container with ID starting with cb0caeda46ccac24d57e7c39b1742470e6243aa38a1e74c031d2b3877112440c not found: ID does not exist" Jun 12 21:52:29.919182 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:29.919142 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" path="/var/lib/kubelet/pods/14797d63-f4a7-4f61-865a-cf525d56c325/volumes" Jun 12 21:52:37.094448 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:52:37.094412 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmjv9" Jun 12 21:53:07.470921 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.470884 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw"] Jun 12 21:53:07.471424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.471291 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" containerName="manager" Jun 12 21:53:07.471424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.471304 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" containerName="manager" Jun 12 21:53:07.471424 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.471384 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="14797d63-f4a7-4f61-865a-cf525d56c325" containerName="manager" Jun 12 21:53:07.473549 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.473533 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.475876 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.475857 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hf4vq\"" Jun 12 21:53:07.485015 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.484991 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw"] Jun 12 21:53:07.586275 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586236 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586437 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586287 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586437 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586311 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586437 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586380 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586437 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586427 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586572 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586450 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586572 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586465 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586572 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586485 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gd62\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-kube-api-access-2gd62\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.586572 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.586516 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/752254b6-6967-4aaf-8aad-3a488eefa9c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687532 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687498 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687548 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687586 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687614 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687637 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687695 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687660 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gd62\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-kube-api-access-2gd62\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687700 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/752254b6-6967-4aaf-8aad-3a488eefa9c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687774 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.687951 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.687822 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.688126 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.688010 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.688239 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.688214 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.688375 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.688239 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.688442 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.688311 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.688546 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.688522 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/752254b6-6967-4aaf-8aad-3a488eefa9c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.689789 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.689769 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.690024 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.690004 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.695467 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.695447 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.695566 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.695448 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gd62\" (UniqueName: \"kubernetes.io/projected/752254b6-6967-4aaf-8aad-3a488eefa9c7-kube-api-access-2gd62\") pod \"maas-default-gateway-openshift-default-8559cd5744-675jw\" (UID: \"752254b6-6967-4aaf-8aad-3a488eefa9c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.784750 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.784682 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:07.931175 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.931052 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw"] Jun 12 21:53:07.933333 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:53:07.933308 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752254b6_6967_4aaf_8aad_3a488eefa9c7.slice/crio-01d0d6c15f2a96cf416ebe733aac74979e0c86b756c4dc828a19a2e3e9dfff45 WatchSource:0}: Error finding container 01d0d6c15f2a96cf416ebe733aac74979e0c86b756c4dc828a19a2e3e9dfff45: Status 404 returned error can't find the container with id 01d0d6c15f2a96cf416ebe733aac74979e0c86b756c4dc828a19a2e3e9dfff45 Jun 12 21:53:07.935406 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.935370 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:53:07.935501 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.935450 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:53:07.935501 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:07.935496 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:53:08.298717 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:08.298682 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" event={"ID":"752254b6-6967-4aaf-8aad-3a488eefa9c7","Type":"ContainerStarted","Data":"4cc1ec54bfe3d09ca38ce601642172f52a7b4ead6cdca963309f1f3d5f10136a"} Jun 12 21:53:08.298903 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:08.298741 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" event={"ID":"752254b6-6967-4aaf-8aad-3a488eefa9c7","Type":"ContainerStarted","Data":"01d0d6c15f2a96cf416ebe733aac74979e0c86b756c4dc828a19a2e3e9dfff45"} Jun 12 21:53:08.318502 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:08.318455 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" podStartSLOduration=1.318439315 podStartE2EDuration="1.318439315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:53:08.315901162 +0000 UTC m=+480.832041022" watchObservedRunningTime="2026-06-12 21:53:08.318439315 +0000 UTC m=+480.834579174" Jun 12 21:53:08.785266 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:08.785233 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:08.790515 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:08.790491 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:09.303835 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:09.303805 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:09.304920 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:09.304898 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:53:10.172418 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.172385 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:53:10.174793 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.174767 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.176707 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.176689 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 21:53:10.176893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.176880 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lhbf6\"" Jun 12 21:53:10.183959 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.183936 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:53:10.208974 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.208947 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/109099ad-c503-4d06-9c2a-596d2e324a46-config-file\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.209125 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.209008 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx87k\" (UniqueName: \"kubernetes.io/projected/109099ad-c503-4d06-9c2a-596d2e324a46-kube-api-access-qx87k\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.220893 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.220870 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:53:10.309922 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.309881 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/109099ad-c503-4d06-9c2a-596d2e324a46-config-file\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.310082 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.309969 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx87k\" (UniqueName: \"kubernetes.io/projected/109099ad-c503-4d06-9c2a-596d2e324a46-kube-api-access-qx87k\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.310511 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.310493 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/109099ad-c503-4d06-9c2a-596d2e324a46-config-file\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.317174 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.317149 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx87k\" (UniqueName: \"kubernetes.io/projected/109099ad-c503-4d06-9c2a-596d2e324a46-kube-api-access-qx87k\") pod \"limitador-limitador-54d6d988d5-zrtxx\" (UID: \"109099ad-c503-4d06-9c2a-596d2e324a46\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.486173 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.486105 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:10.632017 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:10.631993 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:53:10.634433 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:53:10.634406 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109099ad_c503_4d06_9c2a_596d2e324a46.slice/crio-15e29e0189ec88938ff394e7fe0c40f7353b5b735cf8c0ee196e34a12a82f042 WatchSource:0}: Error finding container 15e29e0189ec88938ff394e7fe0c40f7353b5b735cf8c0ee196e34a12a82f042: Status 404 returned error can't find the container with id 15e29e0189ec88938ff394e7fe0c40f7353b5b735cf8c0ee196e34a12a82f042 Jun 12 21:53:11.316659 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:11.316619 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" event={"ID":"109099ad-c503-4d06-9c2a-596d2e324a46","Type":"ContainerStarted","Data":"15e29e0189ec88938ff394e7fe0c40f7353b5b735cf8c0ee196e34a12a82f042"} Jun 12 21:53:13.328709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:13.328623 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" event={"ID":"109099ad-c503-4d06-9c2a-596d2e324a46","Type":"ContainerStarted","Data":"089a1c6281396193643d10348d7271865ffac375398ef4b8788f862f7e11a887"} Jun 12 21:53:13.328709 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:13.328679 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:53:13.343969 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:13.343892 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" podStartSLOduration=0.901601674 podStartE2EDuration="3.343873857s" totalImagesPullingTime="2.442272183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:53:13.343336523 +0000 UTC m=+485.859476408" watchObservedRunningTime="2026-06-12 21:53:13.343873857 +0000 UTC m=+485.860013716" Jun 12 21:53:24.334420 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:53:24.334381 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zrtxx" Jun 12 21:55:07.894929 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:07.894898 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:55:07.896061 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:07.896035 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 21:55:08.719807 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.719779 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fh7r2"] Jun 12 21:55:08.723400 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.723377 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:08.725187 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.725161 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:55:08.727254 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.727238 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 21:55:08.734386 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.734362 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rnrcg\"" Jun 12 21:55:08.735668 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.735646 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fh7r2"] Jun 12 21:55:08.843669 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.843629 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk6x6\" (UniqueName: \"kubernetes.io/projected/fd43472a-dc2c-4e73-b0b6-54ffbd3bd061-kube-api-access-nk6x6\") pod \"payload-processing-699b6cd6c-fh7r2\" (UID: \"fd43472a-dc2c-4e73-b0b6-54ffbd3bd061\") " pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:08.944732 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.944702 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk6x6\" (UniqueName: \"kubernetes.io/projected/fd43472a-dc2c-4e73-b0b6-54ffbd3bd061-kube-api-access-nk6x6\") pod \"payload-processing-699b6cd6c-fh7r2\" (UID: \"fd43472a-dc2c-4e73-b0b6-54ffbd3bd061\") " pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:08.964313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:08.964287 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk6x6\" (UniqueName: \"kubernetes.io/projected/fd43472a-dc2c-4e73-b0b6-54ffbd3bd061-kube-api-access-nk6x6\") pod \"payload-processing-699b6cd6c-fh7r2\" (UID: \"fd43472a-dc2c-4e73-b0b6-54ffbd3bd061\") " pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:09.034931 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:09.034860 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:09.196271 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:09.196187 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fh7r2"] Jun 12 21:55:09.200412 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:55:09.200381 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd43472a_dc2c_4e73_b0b6_54ffbd3bd061.slice/crio-bcc7b2cd454cdad697ac078d4c979f1dfbaaddf9bc9cca1eac02723cff83a810 WatchSource:0}: Error finding container bcc7b2cd454cdad697ac078d4c979f1dfbaaddf9bc9cca1eac02723cff83a810: Status 404 returned error can't find the container with id bcc7b2cd454cdad697ac078d4c979f1dfbaaddf9bc9cca1eac02723cff83a810 Jun 12 21:55:09.916382 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:09.916308 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" event={"ID":"fd43472a-dc2c-4e73-b0b6-54ffbd3bd061","Type":"ContainerStarted","Data":"bcc7b2cd454cdad697ac078d4c979f1dfbaaddf9bc9cca1eac02723cff83a810"} Jun 12 21:55:11.924805 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:11.924774 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" event={"ID":"fd43472a-dc2c-4e73-b0b6-54ffbd3bd061","Type":"ContainerStarted","Data":"ae77c51a0ae27b4f44625f41d3c123d38da702bea7dad0aa19b58b3fc1d710f3"} Jun 12 21:55:11.925171 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:11.924840 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:55:11.942154 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:11.942078 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" podStartSLOduration=1.335506734 podStartE2EDuration="3.94206026s" totalImagesPullingTime="2.606553526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:55:11.941209633 +0000 UTC m=+604.457349516" watchObservedRunningTime="2026-06-12 21:55:11.94206026 +0000 UTC m=+604.458200122" Jun 12 21:55:15.947534 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.947503 2548 generic.go:356] "Generic (PLEG): container finished" podID="752254b6-6967-4aaf-8aad-3a488eefa9c7" containerID="4cc1ec54bfe3d09ca38ce601642172f52a7b4ead6cdca963309f1f3d5f10136a" exitCode=0 Jun 12 21:55:15.947890 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.947557 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" event={"ID":"752254b6-6967-4aaf-8aad-3a488eefa9c7","Type":"ContainerDied","Data":"4cc1ec54bfe3d09ca38ce601642172f52a7b4ead6cdca963309f1f3d5f10136a"} Jun 12 21:55:15.947967 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.947951 2548 scope.go:117] "RemoveContainer" containerID="4cc1ec54bfe3d09ca38ce601642172f52a7b4ead6cdca963309f1f3d5f10136a" Jun 12 21:55:15.948939 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.948908 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:55:15.949008 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.948990 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:55:15.949046 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:15.949036 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 21:55:16.954686 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:16.954650 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" event={"ID":"752254b6-6967-4aaf-8aad-3a488eefa9c7","Type":"ContainerStarted","Data":"f7096e1dc617c5c7a3d9b189bc96851bb0ebcebf7d7731b308658a222df3ecd4"} Jun 12 21:55:17.785819 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:17.785323 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:55:17.785819 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:17.785475 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-675jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 12 21:55:17.785819 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:17.785522 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" podUID="752254b6-6967-4aaf-8aad-3a488eefa9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 12 21:55:18.786213 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:18.786172 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-675jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 12 21:55:18.786737 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:18.786237 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" podUID="752254b6-6967-4aaf-8aad-3a488eefa9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 12 21:55:19.785442 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:19.785409 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-675jw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 12 21:55:19.785761 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:19.785712 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" podUID="752254b6-6967-4aaf-8aad-3a488eefa9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 12 21:55:20.789297 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:20.789264 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:55:20.789746 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:20.789543 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:55:20.790294 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:20.790277 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-675jw" Jun 12 21:55:22.932268 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:55:22.932237 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-fh7r2" Jun 12 21:58:22.972106 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:58:22.972049 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:58:42.363516 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:58:42.363433 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:58:47.618915 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:58:47.618884 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:59:07.577019 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.576983 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9"] Jun 12 21:59:07.580738 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.580717 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.583058 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.583038 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 21:59:07.583172 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.583038 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 21:59:07.583927 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.583909 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8xts8\"" Jun 12 21:59:07.583927 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.583922 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 21:59:07.594623 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.594601 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9"] Jun 12 21:59:07.685915 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.685882 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8bbv\" (UniqueName: \"kubernetes.io/projected/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kube-api-access-t8bbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.686081 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.685924 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.686081 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.685959 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.686081 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.686045 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.686239 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.686144 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.686239 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.686169 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787474 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787442 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787512 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8bbv\" (UniqueName: \"kubernetes.io/projected/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kube-api-access-t8bbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787563 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787632 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787918 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787818 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.787918 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.787875 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.788052 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.788035 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.789658 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.789638 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.789813 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.789794 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.795174 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.795147 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8bbv\" (UniqueName: \"kubernetes.io/projected/ecf2ff2d-0c0e-4077-97d6-769f0e45466d-kube-api-access-t8bbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9\" (UID: \"ecf2ff2d-0c0e-4077-97d6-769f0e45466d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:07.894927 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.894902 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8xts8\"" Jun 12 21:59:07.903548 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:07.903530 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 21:59:08.038943 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:08.038919 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9"] Jun 12 21:59:08.041228 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:59:08.041202 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf2ff2d_0c0e_4077_97d6_769f0e45466d.slice/crio-c9b229fe37d6c0389b61e35296998abf5f545cc04824614b448db39a5b5dd208 WatchSource:0}: Error finding container c9b229fe37d6c0389b61e35296998abf5f545cc04824614b448db39a5b5dd208: Status 404 returned error can't find the container with id c9b229fe37d6c0389b61e35296998abf5f545cc04824614b448db39a5b5dd208 Jun 12 21:59:08.050334 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:08.050294 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:59:08.107647 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:08.107615 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" event={"ID":"ecf2ff2d-0c0e-4077-97d6-769f0e45466d","Type":"ContainerStarted","Data":"c9b229fe37d6c0389b61e35296998abf5f545cc04824614b448db39a5b5dd208"} Jun 12 21:59:08.465905 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:08.465863 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:59:12.135423 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:12.135387 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" event={"ID":"ecf2ff2d-0c0e-4077-97d6-769f0e45466d","Type":"ContainerStarted","Data":"c0e419852b258fbab5495961ed57e3a1d6dc75fe9f529ee88343d5a220291563"} Jun 12 21:59:17.904515 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:17.904485 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q"] Jun 12 21:59:17.910279 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:17.910256 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:17.914443 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:17.914421 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 21:59:17.929288 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:17.929251 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q"] Jun 12 21:59:18.087466 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087433 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.087466 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d140c6c-89ef-4f37-b02d-1eb5c995a415-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.087663 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.087663 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087560 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.087663 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087610 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.087775 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.087708 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnz8s\" (UniqueName: \"kubernetes.io/projected/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kube-api-access-hnz8s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189050 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.188969 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnz8s\" (UniqueName: \"kubernetes.io/projected/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kube-api-access-hnz8s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189050 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189025 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189373 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189062 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d140c6c-89ef-4f37-b02d-1eb5c995a415-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189373 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189106 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189373 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189130 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189373 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189160 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189589 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189383 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189589 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189522 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.189669 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.189600 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.191363 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.191342 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d140c6c-89ef-4f37-b02d-1eb5c995a415-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.191579 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.191564 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d140c6c-89ef-4f37-b02d-1eb5c995a415-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.198887 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.198864 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnz8s\" (UniqueName: \"kubernetes.io/projected/0d140c6c-89ef-4f37-b02d-1eb5c995a415-kube-api-access-hnz8s\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fh55q\" (UID: \"0d140c6c-89ef-4f37-b02d-1eb5c995a415\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.221779 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.221753 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:18.353754 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.353731 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q"] Jun 12 21:59:18.355919 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:59:18.355895 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d140c6c_89ef_4f37_b02d_1eb5c995a415.slice/crio-6a4bbc8863bf0eb23b6168d8c299c80e9578e3c0e7d86252ee19497d3a001155 WatchSource:0}: Error finding container 6a4bbc8863bf0eb23b6168d8c299c80e9578e3c0e7d86252ee19497d3a001155: Status 404 returned error can't find the container with id 6a4bbc8863bf0eb23b6168d8c299c80e9578e3c0e7d86252ee19497d3a001155 Jun 12 21:59:18.880670 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:18.880633 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 21:59:19.171826 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:19.171739 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" event={"ID":"0d140c6c-89ef-4f37-b02d-1eb5c995a415","Type":"ContainerStarted","Data":"5a6fe690429a6d41a91c3a0c5d0a7d21b225318d2f1ad0f33f1f36ad99c5e726"} Jun 12 21:59:19.171826 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:19.171808 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" event={"ID":"0d140c6c-89ef-4f37-b02d-1eb5c995a415","Type":"ContainerStarted","Data":"6a4bbc8863bf0eb23b6168d8c299c80e9578e3c0e7d86252ee19497d3a001155"} Jun 12 21:59:23.191229 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:23.191148 2548 generic.go:356] "Generic (PLEG): container finished" podID="0d140c6c-89ef-4f37-b02d-1eb5c995a415" containerID="5a6fe690429a6d41a91c3a0c5d0a7d21b225318d2f1ad0f33f1f36ad99c5e726" exitCode=0 Jun 12 21:59:23.191229 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:23.191181 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" event={"ID":"0d140c6c-89ef-4f37-b02d-1eb5c995a415","Type":"ContainerDied","Data":"5a6fe690429a6d41a91c3a0c5d0a7d21b225318d2f1ad0f33f1f36ad99c5e726"} Jun 12 21:59:25.203298 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:25.203263 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" event={"ID":"0d140c6c-89ef-4f37-b02d-1eb5c995a415","Type":"ContainerStarted","Data":"855114fca55080f55ed13b05ade9e549f8d5dffc5c600faf64353f8f3c41362e"} Jun 12 21:59:25.222038 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:25.221991 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" podStartSLOduration=2.30440298 podStartE2EDuration="8.221977245s" totalImagesPullingTime="1.444887528s" totalInitContainerRuntime="4.472686737s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:59:25.220407708 +0000 UTC m=+857.736547602" watchObservedRunningTime="2026-06-12 21:59:25.221977245 +0000 UTC m=+857.738117139" Jun 12 21:59:28.221910 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:28.221877 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:28.222313 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:28.221943 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:28.234608 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:28.234583 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:29.233910 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:29.233883 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fh55q" Jun 12 21:59:31.275379 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.275347 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd"] Jun 12 21:59:31.279113 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.279095 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.281296 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.281266 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 21:59:31.289450 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.289425 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd"] Jun 12 21:59:31.301289 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301254 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzpzl\" (UniqueName: \"kubernetes.io/projected/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kube-api-access-wzpzl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.301425 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301295 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.301425 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301354 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.301550 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301446 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.301550 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301483 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.301550 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.301507 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402586 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402550 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402586 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402587 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402792 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402620 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402792 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpzl\" (UniqueName: \"kubernetes.io/projected/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kube-api-access-wzpzl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402792 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402740 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.402792 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.402766 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.403104 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.403066 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.403251 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.403114 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.403251 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.403151 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.404868 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.404833 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.405121 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.405100 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.411540 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.411523 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzpzl\" (UniqueName: \"kubernetes.io/projected/6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06-kube-api-access-wzpzl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-pn6cd\" (UID: \"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.590606 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.590501 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 21:59:31.728324 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:31.728294 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd"] Jun 12 21:59:31.730901 ip-10-0-130-85 kubenswrapper[2548]: W0612 21:59:31.730876 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2a6e4e_69ea_4d7b_b910_9aad9ae23d06.slice/crio-623eb53f3540a3c61bb5d8659772904dafe9dd42d2e8613d7e27a049ace3cfac WatchSource:0}: Error finding container 623eb53f3540a3c61bb5d8659772904dafe9dd42d2e8613d7e27a049ace3cfac: Status 404 returned error can't find the container with id 623eb53f3540a3c61bb5d8659772904dafe9dd42d2e8613d7e27a049ace3cfac Jun 12 21:59:32.239250 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:32.239213 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" event={"ID":"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06","Type":"ContainerStarted","Data":"57ae5ce2c3ade576f1cb230d8eab29224c788fa94f0428f0a138a4d9156d2272"} Jun 12 21:59:32.239428 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:32.239263 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" event={"ID":"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06","Type":"ContainerStarted","Data":"623eb53f3540a3c61bb5d8659772904dafe9dd42d2e8613d7e27a049ace3cfac"} Jun 12 21:59:32.566885 ip-10-0-130-85 kubenswrapper[2548]: I0612 21:59:32.566813 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:00:05.408542 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:05.408503 2548 generic.go:356] "Generic (PLEG): container finished" podID="ecf2ff2d-0c0e-4077-97d6-769f0e45466d" containerID="c0e419852b258fbab5495961ed57e3a1d6dc75fe9f529ee88343d5a220291563" exitCode=0 Jun 12 22:00:05.408894 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:05.408567 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" event={"ID":"ecf2ff2d-0c0e-4077-97d6-769f0e45466d","Type":"ContainerDied","Data":"c0e419852b258fbab5495961ed57e3a1d6dc75fe9f529ee88343d5a220291563"} Jun 12 22:00:06.415321 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:06.415285 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" event={"ID":"ecf2ff2d-0c0e-4077-97d6-769f0e45466d","Type":"ContainerStarted","Data":"4b8458a1c539e707dd136e6bf8cc1bb62a724cdecedaa87190ca42aee064bb9a"} Jun 12 22:00:06.433551 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:06.433501 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" podStartSLOduration=1.679498432 podStartE2EDuration="59.433485428s" totalImagesPullingTime="3.843157273s" totalInitContainerRuntime="53.910829723s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:59:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:00:06.432553665 +0000 UTC m=+898.948693517" watchObservedRunningTime="2026-06-12 22:00:06.433485428 +0000 UTC m=+898.949625309" Jun 12 22:00:07.903739 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:07.903710 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 22:00:07.904148 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:07.903770 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 22:00:07.919954 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:07.919928 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 22:00:07.931574 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:07.931551 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:00:07.933191 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:07.933173 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:00:08.441896 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:00:08.441866 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9" Jun 12 22:01:19.785855 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:19.785822 2548 generic.go:356] "Generic (PLEG): container finished" podID="6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06" containerID="57ae5ce2c3ade576f1cb230d8eab29224c788fa94f0428f0a138a4d9156d2272" exitCode=0 Jun 12 22:01:19.786287 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:19.785893 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" event={"ID":"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06","Type":"ContainerDied","Data":"57ae5ce2c3ade576f1cb230d8eab29224c788fa94f0428f0a138a4d9156d2272"} Jun 12 22:01:20.792715 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:20.792679 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" event={"ID":"6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06","Type":"ContainerStarted","Data":"9bd5a0bf578a579596cefc36e345641490cd3b531609964ee4f3221117197d6a"} Jun 12 22:01:20.814747 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:20.814694 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" podStartSLOduration=2.469652492 podStartE2EDuration="1m49.814680006s" totalImagesPullingTime="328.705652ms" totalInitContainerRuntime="1m47.016321862s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:01:20.811983717 +0000 UTC m=+973.328123575" watchObservedRunningTime="2026-06-12 22:01:20.814680006 +0000 UTC m=+973.330819865" Jun 12 22:01:21.590606 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:21.590572 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 22:01:21.590779 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:21.590620 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 22:01:21.602615 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:21.602587 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 22:01:21.809402 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:21.809374 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-pn6cd" Jun 12 22:01:56.462649 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:01:56.462607 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:02:06.170581 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:02:06.170544 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:02:15.471835 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:02:15.471798 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:02:24.971263 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:02:24.971232 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:02:34.966821 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:02:34.966786 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:02:44.471251 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:02:44.471218 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:03:18.772832 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:03:18.772790 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:03:23.570309 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:03:23.570272 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:03:59.270478 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:03:59.270439 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:04:15.861772 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:04:15.861740 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:04:54.769251 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:04:54.769170 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:05:07.964864 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:05:07.964839 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:05:07.966356 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:05:07.966336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:05:11.189705 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:05:11.189671 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:05:25.801506 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:05:25.801472 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:05:43.287893 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:05:43.287861 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:06:17.375605 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:06:17.375571 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:06:21.805709 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:06:21.805668 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:06:42.668144 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:06:42.668110 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:06:51.663261 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:06:51.663226 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:07:08.469485 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:07:08.469452 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:07:16.776290 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:07:16.776256 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:07:34.174931 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:07:34.174852 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:07:42.974577 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:07:42.974546 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:15.181812 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:15.181776 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:23.185953 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:23.185910 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:26.478987 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:26.478952 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:32.866211 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:32.866173 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:40.465323 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:40.465287 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:48.883028 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:48.882990 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:08:57.574518 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:08:57.574434 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:09:01.658874 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:09:01.658835 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:09:14.356223 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:09:14.356191 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:09:27.362633 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:09:27.362601 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:10:07.998433 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:07.998394 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:10:08.001217 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:08.001200 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:10:17.460240 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:17.460205 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:10:24.062843 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:24.062807 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:10:43.264476 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:43.264392 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:10:48.068662 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:48.068631 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:10:51.667031 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:10:51.667000 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:01.888299 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:01.888265 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:09.565631 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:09.565595 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:19.781916 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:19.781875 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:27.572849 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:27.572812 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:37.263813 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:37.263779 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:44.374014 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:44.373978 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:11:52.663641 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:11:52.663596 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:12:00.971554 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:12:00.971474 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:14:26.081431 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:14:26.081396 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:14:30.764480 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:14:30.764447 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:14:57.280341 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:14:57.280263 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:01.014154 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:01.014109 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:08.034001 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:08.033971 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:15:08.037305 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:08.037284 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:15:11.665727 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:11.665696 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:20.375632 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:20.375595 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:31.072945 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:31.072907 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:39.986563 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:39.986525 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:49.471789 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:49.471747 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:15:59.855594 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:15:59.855551 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:16:08.663722 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:16:08.663679 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:16:19.563607 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:16:19.563576 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:16:28.342399 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:16:28.342318 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:16:33.062618 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:16:33.062583 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:17:01.067787 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:17:01.067750 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:17:45.153940 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:17:45.153902 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:17:52.456462 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:17:52.456419 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:02.467431 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:02.467344 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:10.366839 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:10.366799 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:19.561718 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:19.561682 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:31.157927 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:31.157887 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:41.155632 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:41.155598 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:45.970195 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:45.970158 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:18:53.558265 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:18:53.558230 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:01.159795 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:01.159758 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:08.857504 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:08.857465 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:19.469734 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:19.469692 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:38.892046 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:38.891965 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:45.958676 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:45.958642 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:19:55.658045 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:19:55.658000 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:03.055534 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:03.055502 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:08.071678 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:08.071648 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:20:08.076122 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:08.076099 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trzn4_7e49afc2-528d-40c5-ade4-27a997d53787/ovn-acl-logging/0.log" Jun 12 22:20:19.964564 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:19.964526 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:28.165211 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:28.165180 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:38.367054 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:38.367021 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:44.960603 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:44.960571 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:20:55.955505 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:20:55.955418 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:03.755096 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:03.755045 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:11.970717 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:11.970688 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:22.957222 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:22.957185 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:33.161844 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:33.161807 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:45.075246 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:45.075208 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:55.753759 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:55.753720 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:21:59.960938 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:21:59.960904 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:07.961127 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:07.961079 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:12.957098 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:12.957047 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:28.861995 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:28.861914 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:37.458363 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:37.458327 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:46.864949 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:46.864910 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:22:52.963584 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:22:52.963544 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:23:14.460770 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:14.460731 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:23:26.763530 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:26.763494 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zrtxx"] Jun 12 22:23:27.647677 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.647629 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:27.651687 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.651492 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.653600 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.653577 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-88768c4d-openshift-default-dockercfg-wv7c6\"" Jun 12 22:23:27.672692 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.672664 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:27.687241 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687219 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvqn\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687351 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687248 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687351 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687274 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687351 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687311 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687461 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687393 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687461 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687432 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687550 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687461 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687550 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687481 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.687650 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.687554 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788430 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788400 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788470 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788499 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788524 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788546 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788577 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788652 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvqn\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788677 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.788827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788709 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.789221 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788886 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.789221 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.788936 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.789335 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.789261 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.789335 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.789308 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.789471 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.789449 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.791110 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.791056 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.791231 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.791190 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.800966 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.800946 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvqn\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.802265 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.802249 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token\") pod \"e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:27.962605 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:27.962517 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:28.106338 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.106313 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:28.107718 ip-10-0-130-85 kubenswrapper[2548]: W0612 22:23:28.107690 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb6a0c6_48ae_4280_9a7f_fdf1c3c29817.slice/crio-87b6c63ca50b17912545af000f3e27148485ca06c750e04003616dc783842d41 WatchSource:0}: Error finding container 87b6c63ca50b17912545af000f3e27148485ca06c750e04003616dc783842d41: Status 404 returned error can't find the container with id 87b6c63ca50b17912545af000f3e27148485ca06c750e04003616dc783842d41 Jun 12 22:23:28.109941 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.109908 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 22:23:28.110033 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.109971 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 22:23:28.110033 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.110001 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 22:23:28.659161 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.659123 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" event={"ID":"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817","Type":"ContainerStarted","Data":"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf"} Jun 12 22:23:28.659345 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.659178 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" event={"ID":"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817","Type":"ContainerStarted","Data":"87b6c63ca50b17912545af000f3e27148485ca06c750e04003616dc783842d41"} Jun 12 22:23:28.683503 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.683455 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" podStartSLOduration=1.683440147 podStartE2EDuration="1.683440147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:23:28.680181913 +0000 UTC m=+2301.196321774" watchObservedRunningTime="2026-06-12 22:23:28.683440147 +0000 UTC m=+2301.199580005" Jun 12 22:23:28.962650 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:28.962570 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:29.968016 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:29.967987 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:30.668889 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:30.668858 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:30.669690 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:30.669672 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:34.112703 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:34.112667 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:34.113150 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:34.112869 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" podUID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" containerName="istio-proxy" containerID="cri-o://b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf" gracePeriod=30 Jun 12 22:23:39.377738 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.377677 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:39.499162 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499132 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499179 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499211 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499229 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499266 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trvqn\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499303 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499326 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499362 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499354 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499721 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499385 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token\") pod \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\" (UID: \"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817\") " Jun 12 22:23:39.499721 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499453 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:39.499721 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499587 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:39.499721 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499699 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499722 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499730 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499836 2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-certs\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499855 2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-data\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499869 2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istiod-ca-cert\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499881 2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-workload-socket\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.499923 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.499894 2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-credential-socket\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.501647 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.501621 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 22:23:39.501647 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.501635 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn" (OuterVolumeSpecName: "kube-api-access-trvqn") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "kube-api-access-trvqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:39.501854 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.501741 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:39.501854 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.501765 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" (UID: "6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:39.601174 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.601150 2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-token\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.601174 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.601170 2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-envoy\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.601313 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.601179 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trvqn\" (UniqueName: \"kubernetes.io/projected/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-kube-api-access-trvqn\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.601313 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.601189 2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817-istio-podinfo\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 12 22:23:39.717735 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.717666 2548 generic.go:356] "Generic (PLEG): container finished" podID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" containerID="b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf" exitCode=0 Jun 12 22:23:39.717735 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.717717 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" Jun 12 22:23:39.717865 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.717759 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" event={"ID":"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817","Type":"ContainerDied","Data":"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf"} Jun 12 22:23:39.717865 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.717818 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg" event={"ID":"6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817","Type":"ContainerDied","Data":"87b6c63ca50b17912545af000f3e27148485ca06c750e04003616dc783842d41"} Jun 12 22:23:39.717865 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.717847 2548 scope.go:117] "RemoveContainer" containerID="b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf" Jun 12 22:23:39.727285 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.727270 2548 scope.go:117] "RemoveContainer" containerID="b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf" Jun 12 22:23:39.727532 ip-10-0-130-85 kubenswrapper[2548]: E0612 22:23:39.727514 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf\": container with ID starting with b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf not found: ID does not exist" containerID="b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf" Jun 12 22:23:39.727583 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.727541 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf"} err="failed to get container status \"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf\": rpc error: code = NotFound desc = could not find container \"b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf\": container with ID starting with b4e9455d62b7e89f9f491255d5d462f2c2650e061c09c67a4cf37057cbeccccf not found: ID does not exist" Jun 12 22:23:39.738762 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.738739 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:39.742420 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.742398 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-88768c4d-openshift-default-655fddd66b-zstpg"] Jun 12 22:23:39.913592 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:23:39.913552 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" path="/var/lib/kubelet/pods/6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817/volumes" Jun 12 22:24:04.501948 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:04.501870 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c8dbcfd65-q49wn_1e1f70c6-cba1-4a5b-9b39-37151ac1900e/nginx/0.log" Jun 12 22:24:05.920187 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:05.920154 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6565f6c44d-gnvgs_c561739d-3f6f-442d-90a4-6dc78832ccad/copy-manifests/0.log" Jun 12 22:24:05.928372 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:05.928342 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6565f6c44d-gnvgs_c561739d-3f6f-442d-90a4-6dc78832ccad/manager/0.log" Jun 12 22:24:07.387258 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:07.387228 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tzcwm_73b4d4df-7c7f-441d-bc7a-b109b871472d/manager/0.log" Jun 12 22:24:07.492073 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:07.492045 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bxscl_66fa3d6b-96bc-479f-8e9c-8a9c027017f2/manager/0.log" Jun 12 22:24:07.714394 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:07.714323 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kbgk9_9959a1ee-5c86-4121-8e3c-770e9b13c8d5/registry-server/0.log" Jun 12 22:24:07.940400 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:07.940370 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zrtxx_109099ad-c503-4d06-9c2a-596d2e324a46/limitador/0.log" Jun 12 22:24:08.060115 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:08.060028 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nmjv9_0eac5b00-da91-4295-a1d3-94def2d96478/manager/0.log" Jun 12 22:24:08.402788 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:08.402750 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcb7l6f_a0ac0773-43ab-4b4a-ba71-cb45f571bdc7/istio-proxy/0.log" Jun 12 22:24:08.870268 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:08.870232 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/1.log" Jun 12 22:24:09.115069 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:09.115037 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fh7r2_fd43472a-dc2c-4e73-b0b6-54ffbd3bd061/payload-processing/0.log" Jun 12 22:24:09.924826 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:09.924787 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9_ecf2ff2d-0c0e-4077-97d6-769f0e45466d/storage-initializer/0.log" Jun 12 22:24:09.932849 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:09.932822 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8m4v9_ecf2ff2d-0c0e-4077-97d6-769f0e45466d/main/0.log" Jun 12 22:24:10.044025 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:10.044005 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fh55q_0d140c6c-89ef-4f37-b02d-1eb5c995a415/storage-initializer/0.log" Jun 12 22:24:10.052137 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:10.052117 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fh55q_0d140c6c-89ef-4f37-b02d-1eb5c995a415/main/0.log" Jun 12 22:24:10.160287 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:10.160254 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-pn6cd_6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06/main/0.log" Jun 12 22:24:10.167296 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:10.167274 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-pn6cd_6b2a6e4e-69ea-4d7b-b910-9aad9ae23d06/storage-initializer/0.log" Jun 12 22:24:14.396441 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.396402 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d49q6/must-gather-nshrq"] Jun 12 22:24:14.396845 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.396832 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" containerName="istio-proxy" Jun 12 22:24:14.396890 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.396846 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" containerName="istio-proxy" Jun 12 22:24:14.396925 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.396911 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb6a0c6-48ae-4280-9a7f-fdf1c3c29817" containerName="istio-proxy" Jun 12 22:24:14.401267 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.401248 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.403726 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.403706 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d49q6\"/\"openshift-service-ca.crt\"" Jun 12 22:24:14.403827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.403723 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d49q6\"/\"kube-root-ca.crt\"" Jun 12 22:24:14.403827 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.403712 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d49q6\"/\"default-dockercfg-4lfw7\"" Jun 12 22:24:14.409129 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.409104 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d49q6/must-gather-nshrq"] Jun 12 22:24:14.531562 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.531528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-must-gather-output\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.531721 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.531608 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h84b\" (UniqueName: \"kubernetes.io/projected/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-kube-api-access-8h84b\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.632225 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.632198 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-must-gather-output\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.632371 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.632248 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h84b\" (UniqueName: \"kubernetes.io/projected/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-kube-api-access-8h84b\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.632568 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.632547 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-must-gather-output\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.639740 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.639711 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h84b\" (UniqueName: \"kubernetes.io/projected/3fabc456-6e58-4a8c-9daf-a0bf0298eb97-kube-api-access-8h84b\") pod \"must-gather-nshrq\" (UID: \"3fabc456-6e58-4a8c-9daf-a0bf0298eb97\") " pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.712031 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.711962 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d49q6/must-gather-nshrq" Jun 12 22:24:14.842542 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.842517 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d49q6/must-gather-nshrq"] Jun 12 22:24:14.844533 ip-10-0-130-85 kubenswrapper[2548]: W0612 22:24:14.844509 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fabc456_6e58_4a8c_9daf_a0bf0298eb97.slice/crio-9e00e52c031f1121db93263659b0a1accd328fda2335ff8a0b4e058da9b48bc0 WatchSource:0}: Error finding container 9e00e52c031f1121db93263659b0a1accd328fda2335ff8a0b4e058da9b48bc0: Status 404 returned error can't find the container with id 9e00e52c031f1121db93263659b0a1accd328fda2335ff8a0b4e058da9b48bc0 Jun 12 22:24:14.846504 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.846487 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:24:14.902076 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:14.902045 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d49q6/must-gather-nshrq" event={"ID":"3fabc456-6e58-4a8c-9daf-a0bf0298eb97","Type":"ContainerStarted","Data":"9e00e52c031f1121db93263659b0a1accd328fda2335ff8a0b4e058da9b48bc0"} Jun 12 22:24:15.922874 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:15.922774 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d49q6/must-gather-nshrq" event={"ID":"3fabc456-6e58-4a8c-9daf-a0bf0298eb97","Type":"ContainerStarted","Data":"8de6fe4f004857edb3d7bf0f890b7017cac168698daa7900534b845bc415de06"} Jun 12 22:24:15.923396 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:15.922894 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d49q6/must-gather-nshrq" event={"ID":"3fabc456-6e58-4a8c-9daf-a0bf0298eb97","Type":"ContainerStarted","Data":"214a15485c2dd0906a7c23eb6388f6f01046953a5f0c6a0f31481b66e78b4646"} Jun 12 22:24:15.938073 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:15.937059 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d49q6/must-gather-nshrq" podStartSLOduration=1.213745421 podStartE2EDuration="1.937038354s" totalImagesPullingTime="723.292933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:15.935882144 +0000 UTC m=+2348.452022004" watchObservedRunningTime="2026-06-12 22:24:15.937038354 +0000 UTC m=+2348.453178216" Jun 12 22:24:17.330016 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:17.329980 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9qtbs_74f3dc65-ce74-40e7-93cd-cca202bd7d3e/global-pull-secret-syncer/0.log" Jun 12 22:24:17.543739 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:17.543702 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qf89h_2433ca0c-1727-45c6-ad10-ac5344109b2f/konnectivity-agent/0.log" Jun 12 22:24:17.593119 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:17.593004 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-85.ec2.internal_81fc4e7aa9137b7763fe31c6de7fca21/haproxy/0.log" Jun 12 22:24:22.060463 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:22.060432 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tzcwm_73b4d4df-7c7f-441d-bc7a-b109b871472d/manager/0.log" Jun 12 22:24:22.101181 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:22.101146 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bxscl_66fa3d6b-96bc-479f-8e9c-8a9c027017f2/manager/0.log" Jun 12 22:24:22.170501 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:22.170466 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kbgk9_9959a1ee-5c86-4121-8e3c-770e9b13c8d5/registry-server/0.log" Jun 12 22:24:22.286259 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:22.286226 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zrtxx_109099ad-c503-4d06-9c2a-596d2e324a46/limitador/0.log" Jun 12 22:24:22.374464 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:22.374431 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nmjv9_0eac5b00-da91-4295-a1d3-94def2d96478/manager/0.log" Jun 12 22:24:24.068763 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.068731 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/alertmanager/0.log" Jun 12 22:24:24.096356 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.096325 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/config-reloader/0.log" Jun 12 22:24:24.122521 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.122445 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/kube-rbac-proxy-web/0.log" Jun 12 22:24:24.146253 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.146205 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/kube-rbac-proxy/0.log" Jun 12 22:24:24.174144 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.174043 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/kube-rbac-proxy-metric/0.log" Jun 12 22:24:24.198033 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.198006 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/prom-label-proxy/0.log" Jun 12 22:24:24.218850 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.218806 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2462c5be-0122-4da7-81ec-2e793484ba56/init-config-reloader/0.log" Jun 12 22:24:24.450502 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.450318 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4rx7b_fdfc9658-64c2-4e85-a561-b2e3b3e1db0f/kube-state-metrics/0.log" Jun 12 22:24:24.467933 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.467667 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4rx7b_fdfc9658-64c2-4e85-a561-b2e3b3e1db0f/kube-rbac-proxy-main/0.log" Jun 12 22:24:24.489278 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.489253 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4rx7b_fdfc9658-64c2-4e85-a561-b2e3b3e1db0f/kube-rbac-proxy-self/0.log" Jun 12 22:24:24.515735 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.515700 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c77794b85-rpj52_9a1ca726-b9aa-4e62-88a9-9227bc6f1c8b/metrics-server/0.log" Jun 12 22:24:24.542026 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.541993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-22v7b_1429fc7f-e4ec-4aef-83ca-8e4ad3942bc7/monitoring-plugin/0.log" Jun 12 22:24:24.742042 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.742014 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbm8l_95dfeb5e-b297-4395-8e6b-226939dfe916/node-exporter/0.log" Jun 12 22:24:24.767631 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.767600 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbm8l_95dfeb5e-b297-4395-8e6b-226939dfe916/kube-rbac-proxy/0.log" Jun 12 22:24:24.786081 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.786044 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbm8l_95dfeb5e-b297-4395-8e6b-226939dfe916/init-textfile/0.log" Jun 12 22:24:24.815289 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.815215 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rsktk_e2f33be2-6946-4873-ae43-9dfaba607485/kube-rbac-proxy-main/0.log" Jun 12 22:24:24.845956 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.845886 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rsktk_e2f33be2-6946-4873-ae43-9dfaba607485/kube-rbac-proxy-self/0.log" Jun 12 22:24:24.866748 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.866718 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-rsktk_e2f33be2-6946-4873-ae43-9dfaba607485/openshift-state-metrics/0.log" Jun 12 22:24:24.903259 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.903225 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/prometheus/0.log" Jun 12 22:24:24.925735 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.925700 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/config-reloader/0.log" Jun 12 22:24:24.948028 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.947994 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/thanos-sidecar/0.log" Jun 12 22:24:24.968313 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.968283 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/kube-rbac-proxy-web/0.log" Jun 12 22:24:24.988890 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:24.988805 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/kube-rbac-proxy/0.log" Jun 12 22:24:25.009655 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.009629 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/kube-rbac-proxy-thanos/0.log" Jun 12 22:24:25.031629 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.031596 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48cfef32-a9a1-443c-a06d-6a525d1c6e9c/init-config-reloader/0.log" Jun 12 22:24:25.157106 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.151959 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-864c446957-qjtm4_bdb6d531-7d4a-4737-9048-57ad70d0be00/telemeter-client/0.log" Jun 12 22:24:25.180075 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.180044 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-864c446957-qjtm4_bdb6d531-7d4a-4737-9048-57ad70d0be00/reload/0.log" Jun 12 22:24:25.200507 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.200478 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-864c446957-qjtm4_bdb6d531-7d4a-4737-9048-57ad70d0be00/kube-rbac-proxy/0.log" Jun 12 22:24:25.234961 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.234928 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/thanos-query/0.log" Jun 12 22:24:25.260980 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.260947 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/kube-rbac-proxy-web/0.log" Jun 12 22:24:25.292663 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.292604 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/kube-rbac-proxy/0.log" Jun 12 22:24:25.316448 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.316283 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/prom-label-proxy/0.log" Jun 12 22:24:25.342186 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.341596 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/kube-rbac-proxy-rules/0.log" Jun 12 22:24:25.371120 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:25.371064 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-846b945f45-6nrvk_64b524c2-9545-4eb3-a5b2-b6de689da632/kube-rbac-proxy-metrics/0.log" Jun 12 22:24:28.116906 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:28.116876 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-88db95576-w2257_ef2b7dba-3587-4781-a974-106bf67a4c40/console/0.log" Jun 12 22:24:28.158658 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:28.158627 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-rzfvl_6b948a6a-8e19-496d-82eb-6482f836890c/download-server/0.log" Jun 12 22:24:29.273143 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.273109 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x"] Jun 12 22:24:29.281621 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.281595 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.284350 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.284322 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x"] Jun 12 22:24:29.312817 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.312784 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-lib-modules\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.312817 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.312817 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-proc\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.313029 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.312866 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf2fv\" (UniqueName: \"kubernetes.io/projected/53d2c6e5-7903-463c-bde1-c8edc1f74899-kube-api-access-zf2fv\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.313029 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.312913 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-sys\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.313029 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.312985 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-podres\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.413890 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.413854 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-podres\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.415136 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.415111 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-lib-modules\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.415466 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.415451 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-proc\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.415686 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.415671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf2fv\" (UniqueName: \"kubernetes.io/projected/53d2c6e5-7903-463c-bde1-c8edc1f74899-kube-api-access-zf2fv\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.416151 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.416131 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-sys\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.416456 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.415616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-proc\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.416565 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.415408 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-lib-modules\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.416655 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.414224 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-podres\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.416737 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.416307 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53d2c6e5-7903-463c-bde1-c8edc1f74899-sys\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.425272 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.425245 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf2fv\" (UniqueName: \"kubernetes.io/projected/53d2c6e5-7903-463c-bde1-c8edc1f74899-kube-api-access-zf2fv\") pod \"perf-node-gather-daemonset-4fx8x\" (UID: \"53d2c6e5-7903-463c-bde1-c8edc1f74899\") " pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.603829 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.603740 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:29.800135 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:29.799788 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x"] Jun 12 22:24:30.045808 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.045771 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" event={"ID":"53d2c6e5-7903-463c-bde1-c8edc1f74899","Type":"ContainerStarted","Data":"e9d903f2405121e774b075061dc3753195212a49719c2028a9dd87c7af61a717"} Jun 12 22:24:30.045993 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.045835 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" event={"ID":"53d2c6e5-7903-463c-bde1-c8edc1f74899","Type":"ContainerStarted","Data":"20af178c929b6af0a89264b645519e23a53edc9921548dd0789c6efed8624ef9"} Jun 12 22:24:30.045993 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.045918 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:30.064495 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.064437 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" podStartSLOduration=1.064415896 podStartE2EDuration="1.064415896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:30.063396404 +0000 UTC m=+2362.579536265" watchObservedRunningTime="2026-06-12 22:24:30.064415896 +0000 UTC m=+2362.580555755" Jun 12 22:24:30.183629 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.183531 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bz472_840f315a-3fdb-4df8-9342-6d0e97a37745/dns/0.log" Jun 12 22:24:30.204160 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.204108 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bz472_840f315a-3fdb-4df8-9342-6d0e97a37745/kube-rbac-proxy/0.log" Jun 12 22:24:30.313666 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.313638 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c8bv9_e65fafc2-56cc-45d8-8a99-d388033f7a9b/dns-node-resolver/0.log" Jun 12 22:24:30.902810 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:30.902778 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-djxr8_1dece1d5-2ffa-4174-b840-d283f95de207/node-ca/0.log" Jun 12 22:24:31.889039 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:31.889001 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcb7l6f_a0ac0773-43ab-4b4a-ba71-cb45f571bdc7/istio-proxy/0.log" Jun 12 22:24:32.062387 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:32.062359 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/0.log" Jun 12 22:24:32.126134 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:32.126078 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/1.log" Jun 12 22:24:32.271068 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:32.270972 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fh7r2_fd43472a-dc2c-4e73-b0b6-54ffbd3bd061/payload-processing/0.log" Jun 12 22:24:32.942774 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:32.942746 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76wmr_27c00552-abc1-46cd-a177-6f15ccaea885/serve-healthcheck-canary/0.log" Jun 12 22:24:33.615918 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:33.615862 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krkmn_3fdf42ec-9a26-40db-827a-66ff22d8393c/kube-rbac-proxy/0.log" Jun 12 22:24:33.634969 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:33.634923 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krkmn_3fdf42ec-9a26-40db-827a-66ff22d8393c/exporter/0.log" Jun 12 22:24:33.655723 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:33.655697 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krkmn_3fdf42ec-9a26-40db-827a-66ff22d8393c/extractor/0.log" Jun 12 22:24:35.786321 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:35.786287 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c8dbcfd65-q49wn_1e1f70c6-cba1-4a5b-9b39-37151ac1900e/nginx/0.log" Jun 12 22:24:36.067498 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:36.067428 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d49q6/perf-node-gather-daemonset-4fx8x" Jun 12 22:24:36.509132 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:36.509082 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6565f6c44d-gnvgs_c561739d-3f6f-442d-90a4-6dc78832ccad/manager/0.log" Jun 12 22:24:36.529474 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:36.529449 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6565f6c44d-gnvgs_c561739d-3f6f-442d-90a4-6dc78832ccad/copy-manifests/0.log" Jun 12 22:24:38.121952 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:38.121921 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5866f54786-kkbtt_ba5fc0a1-93de-4aed-b1ca-d2c54a4cc8d9/manager/0.log" Jun 12 22:24:42.268973 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:42.268937 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcb7l6f_a0ac0773-43ab-4b4a-ba71-cb45f571bdc7/istio-proxy/0.log" Jun 12 22:24:42.495488 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:42.495451 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/0.log" Jun 12 22:24:42.548801 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:42.548710 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/1.log" Jun 12 22:24:42.668909 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:42.668873 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fh7r2_fd43472a-dc2c-4e73-b0b6-54ffbd3bd061/payload-processing/0.log" Jun 12 22:24:43.796323 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:43.796291 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcb7l6f_a0ac0773-43ab-4b4a-ba71-cb45f571bdc7/istio-proxy/0.log" Jun 12 22:24:43.932836 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:43.932804 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/0.log" Jun 12 22:24:43.992471 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:43.992440 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/1.log" Jun 12 22:24:44.107963 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:44.107826 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fh7r2_fd43472a-dc2c-4e73-b0b6-54ffbd3bd061/payload-processing/0.log" Jun 12 22:24:45.379809 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.379776 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-595vf_05a75ae9-263e-4a70-9bf8-80e4dab0a738/kube-multus/0.log" Jun 12 22:24:45.702673 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.702592 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/kube-multus-additional-cni-plugins/0.log" Jun 12 22:24:45.722122 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.722084 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/egress-router-binary-copy/0.log" Jun 12 22:24:45.742236 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.742201 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/cni-plugins/0.log" Jun 12 22:24:45.743641 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.743620 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcb7l6f_a0ac0773-43ab-4b4a-ba71-cb45f571bdc7/istio-proxy/0.log" Jun 12 22:24:45.761768 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.761748 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/bond-cni-plugin/0.log" Jun 12 22:24:45.781473 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.781452 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/routeoverride-cni/0.log" Jun 12 22:24:45.800269 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.800246 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/whereabouts-cni-bincopy/0.log" Jun 12 22:24:45.819451 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.819424 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxpfx_3e3a75f2-e2e1-46ed-b8ed-def392775f38/whereabouts-cni/0.log" Jun 12 22:24:45.892884 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.892856 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/0.log" Jun 12 22:24:45.963034 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.962937 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-675jw_752254b6-6967-4aaf-8aad-3a488eefa9c7/istio-proxy/1.log" Jun 12 22:24:45.965753 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.965715 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m4w6v_f3a93124-08d7-405c-9530-a95446fc306a/network-metrics-daemon/0.log" Jun 12 22:24:45.983536 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:45.983505 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m4w6v_f3a93124-08d7-405c-9530-a95446fc306a/kube-rbac-proxy/0.log" Jun 12 22:24:46.095762 ip-10-0-130-85 kubenswrapper[2548]: I0612 22:24:46.095726 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fh7r2_fd43472a-dc2c-4e73-b0b6-54ffbd3bd061/payload-processing/0.log"