Jun 11 14:56:16.086224 ip-10-0-128-43 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 14:56:16.086240 ip-10-0-128-43 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 14:56:16.086250 ip-10-0-128-43 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 14:56:16.086518 ip-10-0-128-43 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 14:56:25.441435 ip-10-0-128-43 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 14:56:25.441450 ip-10-0-128-43 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 898f38845b3847f0a76e3cc85c63ec9b -- Jun 11 14:58:57.549091 ip-10-0-128-43 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:58:57.978587 ip-10-0-128-43 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:58:57.978587 ip-10-0-128-43 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:58:57.978587 ip-10-0-128-43 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:58:57.978587 ip-10-0-128-43 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:58:57.978587 ip-10-0-128-43 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:58:57.979874 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.979794 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:58:57.985946 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985926 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:57.985946 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985943 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:57.985946 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985948 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:57.985946 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985953 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985958 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985963 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985967 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985971 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985975 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985978 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985982 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985986 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985990 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.985994 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986005 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986009 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986015 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986027 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986032 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986036 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986040 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986044 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:57.986190 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986048 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986053 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986057 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986061 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986065 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986069 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986073 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986079 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986084 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986088 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986092 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986096 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986100 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986104 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986109 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986113 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986118 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986122 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986126 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986143 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986148 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:57.986992 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986153 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986157 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986162 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986166 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986170 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986174 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986178 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986183 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986186 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986190 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986194 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986198 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986203 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986207 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986211 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986215 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986219 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986224 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986228 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986232 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:57.987908 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986236 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986240 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986245 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986250 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986254 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986258 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986263 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986267 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986272 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986277 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986281 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986285 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986289 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986293 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986297 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986301 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986309 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986314 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986319 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986325 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:57.988772 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986330 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986335 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986339 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986344 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986348 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986353 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986358 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986362 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986367 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986371 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986375 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986379 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986383 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986387 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986392 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.986397 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987555 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987564 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987571 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:57.989617 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987575 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987580 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987585 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987589 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987593 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987597 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987602 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987606 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987611 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987615 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987619 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987623 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987629 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987635 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987641 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987645 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987649 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987654 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987658 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:57.990464 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987662 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987666 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987670 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987674 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987679 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987683 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987687 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987691 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987695 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987699 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987703 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987708 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987712 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987717 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987743 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987746 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987751 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987756 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987760 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987764 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:57.991012 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987770 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987774 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987778 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987783 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987790 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987793 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987798 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987802 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987806 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987811 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987815 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987819 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987823 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987827 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987831 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987835 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987839 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987843 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987847 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987851 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:57.991586 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987855 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987859 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987863 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987867 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987872 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987876 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987881 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987885 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987890 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987895 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987903 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987908 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987912 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987917 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987921 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987925 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987930 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987934 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987938 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:57.992278 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987942 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987946 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987951 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987955 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987959 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987964 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987968 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987972 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987976 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987980 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987984 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987988 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987993 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.987997 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988001 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988005 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988009 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988014 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988578 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:57.992828 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988586 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988591 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988595 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988600 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988604 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988608 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988613 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988617 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988621 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988626 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988629 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988634 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988638 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988642 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988646 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988650 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988654 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988658 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988662 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988666 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:57.993306 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988671 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988675 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988680 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988684 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988688 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988692 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988696 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988700 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988704 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988708 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988713 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988740 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988745 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988749 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988753 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988757 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988762 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988766 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988770 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:57.993899 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988774 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988778 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988782 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988785 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988791 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988797 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988801 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988805 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988810 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988815 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988819 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988824 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988830 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988834 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988838 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988845 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988849 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988853 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988858 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:57.994455 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988862 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988866 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988870 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988874 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988881 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988885 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988889 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988893 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988897 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988901 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988906 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988911 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988916 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988922 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988928 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988932 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988936 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988940 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988944 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:57.994924 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988948 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988952 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988956 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988961 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988965 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988969 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988973 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988977 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988981 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988987 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988991 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988995 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.988999 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989003 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989007 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989011 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989018 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989025 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989030 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989034 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:57.995413 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.989038 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989143 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989153 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989162 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989169 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989177 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989182 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989188 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989194 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989199 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989203 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989209 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989214 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989220 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989224 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989228 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989233 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989237 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989242 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989247 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989252 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989259 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989265 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989270 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:58:57.995913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989276 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989280 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989285 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989291 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989295 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989302 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989306 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989311 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989316 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989323 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989327 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989332 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989336 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989341 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989346 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989353 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989359 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989363 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989368 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989373 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989379 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989383 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989388 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989392 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989397 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:58:57.996560 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989402 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989406 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989411 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989415 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989422 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989428 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989434 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989438 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989443 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989448 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989452 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989457 2581 flags.go:64] FLAG: --help="false" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989463 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-43.ec2.internal" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989468 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989473 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989478 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989483 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989488 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989493 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989497 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989502 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989506 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989511 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989516 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:58:57.997216 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989521 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989525 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989530 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989534 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989539 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989543 2581 flags.go:64] FLAG: --lock-file="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989548 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989552 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989557 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989565 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989570 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989574 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989581 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989585 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989591 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989595 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989600 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989606 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989611 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989616 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989622 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989627 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989631 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989635 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989640 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:58:57.997818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989644 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989649 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989660 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989665 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989669 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989674 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989680 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989688 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989693 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989698 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989702 2581 flags.go:64] FLAG: --port="10250" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989707 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989711 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-084b43c901034a32a" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989735 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989741 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989745 2581 flags.go:64] FLAG: --register-node="true" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989750 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989756 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989760 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989767 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989771 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989777 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989782 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989787 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989791 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:58:57.998440 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989795 2581 flags.go:64] FLAG: --runonce="false" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989800 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989805 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989811 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989816 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989820 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989825 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989830 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989835 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989839 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989843 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989848 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989852 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989858 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989863 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989868 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989876 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989880 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989885 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989891 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989896 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989900 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989904 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989909 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989913 2581 flags.go:64] FLAG: --v="2" Jun 11 14:58:57.999081 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989919 2581 flags.go:64] FLAG: --version="false" Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989926 2581 flags.go:64] FLAG: --vmodule="" Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989932 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.989937 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990121 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990128 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990133 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990137 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990142 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990146 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990152 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990156 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990160 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990165 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990169 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990173 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990178 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990182 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990186 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990190 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990194 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:57.999670 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990199 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990203 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990208 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990212 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990216 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990220 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990224 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990228 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990232 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990236 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990241 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990245 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990251 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990255 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990259 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990263 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990267 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990272 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990276 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990280 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:58.000195 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990284 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990289 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990293 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990297 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990302 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990309 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990315 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990320 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990324 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990328 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990332 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990336 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990340 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990344 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990349 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990354 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990358 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990362 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990366 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:58.000677 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990370 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990374 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990378 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990382 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990386 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990392 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990396 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990401 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990406 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990411 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990416 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990420 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990424 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990428 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990434 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990438 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990442 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990447 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990451 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:58.001157 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990454 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990459 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990462 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990466 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990470 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990474 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990478 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990482 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990486 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990493 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990498 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990503 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990507 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990511 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990516 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990519 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990523 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990527 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990533 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990537 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:58.001627 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990541 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990545 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990549 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.990553 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.991352 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.997813 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.997920 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.997939 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.997945 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998005 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998011 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998015 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998018 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998021 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:58.002510 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998023 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998026 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998029 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998033 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998035 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998038 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998041 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998044 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998048 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998052 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998054 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998057 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998060 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998063 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998065 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998068 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998070 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998073 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998076 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998078 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:58.002962 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998081 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998083 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998085 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998088 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998092 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998094 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998097 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998099 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998102 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998104 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998107 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998109 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998112 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998114 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998117 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998119 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998121 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998124 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998126 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998130 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:58.003449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998134 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998136 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998139 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998142 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998144 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998146 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998149 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998151 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998154 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998157 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998159 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998161 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998164 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998167 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998169 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998172 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998175 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998178 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998181 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998183 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:58.003998 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998186 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998188 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998190 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998193 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998197 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998200 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998202 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998205 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998208 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998211 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998213 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998216 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998218 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998221 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998223 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998226 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998228 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998231 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998234 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:58.004484 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998237 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998240 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998242 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998244 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998247 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998249 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998252 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998255 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998257 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998260 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998262 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998265 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998268 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998270 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998272 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:58.005089 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.998277 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998385 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998390 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998393 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998395 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998398 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998401 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998403 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998406 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998410 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998413 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998416 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998419 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998422 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998425 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998427 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998430 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998432 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998435 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998438 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:58:58.005499 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998440 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998443 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998445 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998448 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998450 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998453 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998456 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998458 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998461 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998464 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998466 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998469 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998471 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998474 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998476 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998478 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998481 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998483 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998485 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:58:58.006167 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998488 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998491 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998493 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998496 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998498 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998501 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998503 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998505 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998508 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998510 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998514 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998517 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998520 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998523 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998525 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998528 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998530 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998533 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998535 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:58:58.006642 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998538 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998540 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998543 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998545 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998548 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998550 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998553 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998555 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998557 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998560 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998562 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998565 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998567 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998570 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998572 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998575 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998577 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998579 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998582 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998584 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:58:58.007427 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998587 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998589 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998591 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998594 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998597 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998600 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998603 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998606 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998608 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998610 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998613 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998615 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998618 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998620 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998622 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998627 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998630 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998632 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998635 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:58:58.007974 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998637 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:57.998639 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.998644 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:57.998748 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.001416 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.004736 2581 server.go:1019] "Starting client certificate rotation" Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.004851 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.004907 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:58:58.008587 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.008486 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:58:58.022771 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.022751 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:58:58.032816 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.032802 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:58:58.035065 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.035050 2581 log.go:25] "Validated CRI v1 image API" Jun 11 14:58:58.036796 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.036780 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:58:58.039393 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.039375 2581 fs.go:135] Filesystem UUIDs: map[4be4b3ee-698f-43ba-937f-9af3da7fc35e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c27d76d1-67c6-4aed-aec9-f888d6fda3a3:/dev/nvme0n1p4] Jun 11 14:58:58.039454 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.039391 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:58:58.044153 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.044043 2581 manager.go:216] Machine: {Timestamp:2026-06-11 14:58:58.042809492 +0000 UTC m=+0.364110607 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079760 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e7302aea4316ce3454a78d4c450b7 SystemUUID:ec2e7302-aea4-316c-e345-4a78d4c450b7 BootID:898f3884-5b38-47f0-a76e-3cc85c63ec9b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:d4:3c:68:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:d4:3c:68:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:9b:81:b3:50:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:58:58.044153 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.044148 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:58:58.044259 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.044239 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:58:58.045182 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.045160 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:58:58.045298 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.045184 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-43.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:58:58.046446 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.046436 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:58:58.046491 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.046448 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:58:58.046491 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.046455 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:58:58.048269 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.048257 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:58:58.049027 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.049012 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:58:58.049066 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.049019 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:58:58.051858 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.051846 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:58:58.051960 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.051950 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:58:58.051993 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.051978 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:58:58.051993 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.051988 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:58:58.052046 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.051997 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:58:58.052046 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.052007 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:58:58.052046 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.052015 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:58:58.052403 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.052384 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:58:58.052403 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.052414 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:58:58.059887 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.059850 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:58:58.061996 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.061972 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:58:58.062059 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.062012 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:58:58.063356 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063341 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:58:58.063356 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063358 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063365 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063370 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063378 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063383 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063390 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063396 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063402 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063408 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063416 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:58:58.063464 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063421 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:58:58.063831 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063822 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:58:58.063831 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.063830 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:58:58.064148 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.064123 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:58:58.064148 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.064123 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:58:58.066785 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.066767 2581 server.go:1268] "Started kubelet" Jun 11 14:58:58.066898 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.066850 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:58:58.066898 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.066860 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:58:58.066989 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.066925 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:58:58.067672 ip-10-0-128-43 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:58:58.068785 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.068761 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:58:58.069102 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.069086 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:58:58.069360 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.069339 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-43.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:58:58.073390 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.073374 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:58:58.073463 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.073390 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:58:58.073705 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.073683 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.074214 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074190 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:58:58.074357 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074340 2581 factory.go:55] Registering systemd factory Jun 11 14:58:58.074415 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074373 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:58:58.074415 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074385 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:58:58.074415 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074389 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:58:58.074559 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074516 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:58:58.074559 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074543 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:58:58.074631 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074613 2581 factory.go:153] Registering CRI-O factory Jun 11 14:58:58.074631 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074625 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 14:58:58.074715 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074677 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:58:58.074715 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074694 2581 factory.go:103] Registering Raw factory Jun 11 14:58:58.074715 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.074706 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 14:58:58.075067 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.075050 2581 manager.go:349] Starting recovery of all containers Jun 11 14:58:58.078753 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.076758 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 14:58:58.078753 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.076903 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 14:58:58.078933 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.076972 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-43.ec2.internal.18b80ecfbff7e1f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-43.ec2.internal,UID:ip-10-0-128-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-43.ec2.internal,},FirstTimestamp:2026-06-11 14:58:58.066743793 +0000 UTC m=+0.388044906,LastTimestamp:2026-06-11 14:58:58.066743793 +0000 UTC m=+0.388044906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-43.ec2.internal,}" Jun 11 14:58:58.088492 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.088466 2581 manager.go:354] Recovery completed Jun 11 14:58:58.092457 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.092443 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.094276 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094258 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.094354 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094288 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.094354 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094302 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.094807 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094789 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:58:58.094807 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094803 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:58:58.094898 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094818 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:58:58.094898 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.094796 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.095462 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.095449 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.095525 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.095485 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.095525 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.095495 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.096015 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.096003 2581 policy_none.go:49] "None policy: Start" Jun 11 14:58:58.096052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.096022 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:58:58.096052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.096032 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:58:58.096276 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.096222 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-43.ec2.internal.18b80ecfc19bf5aa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-43.ec2.internal,UID:ip-10-0-128-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-43.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-43.ec2.internal,},FirstTimestamp:2026-06-11 14:58:58.094273962 +0000 UTC m=+0.415575075,LastTimestamp:2026-06-11 14:58:58.094273962 +0000 UTC m=+0.415575075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-43.ec2.internal,}" Jun 11 14:58:58.096958 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.096948 2581 policy_none.go:47] "Start" Jun 11 14:58:58.104268 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.104208 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-43.ec2.internal.18b80ecfc19c43f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-43.ec2.internal,UID:ip-10-0-128-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-43.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-43.ec2.internal,},FirstTimestamp:2026-06-11 14:58:58.094294004 +0000 UTC m=+0.415595120,LastTimestamp:2026-06-11 14:58:58.094294004 +0000 UTC m=+0.415595120,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-43.ec2.internal,}" Jun 11 14:58:58.107091 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.107032 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-43.ec2.internal.18b80ecfc19c7adb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-43.ec2.internal,UID:ip-10-0-128-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-43.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-43.ec2.internal,},FirstTimestamp:2026-06-11 14:58:58.094308059 +0000 UTC m=+0.415609174,LastTimestamp:2026-06-11 14:58:58.094308059 +0000 UTC m=+0.415609174,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-43.ec2.internal,}" Jun 11 14:58:58.109823 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.109785 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65x6s" Jun 11 14:58:58.115041 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.114974 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-43.ec2.internal.18b80ecfc19bf5aa\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-43.ec2.internal.18b80ecfc19bf5aa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-43.ec2.internal,UID:ip-10-0-128-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-43.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-43.ec2.internal,},FirstTimestamp:2026-06-11 14:58:58.094273962 +0000 UTC m=+0.415575075,LastTimestamp:2026-06-11 14:58:58.09546195 +0000 UTC m=+0.416763063,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-43.ec2.internal,}" Jun 11 14:58:58.119575 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.119556 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65x6s" Jun 11 14:58:58.134304 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134290 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.134322 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134331 2581 server.go:87] "Starting device plugin registration server" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134557 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134569 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134671 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134876 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.134887 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.135372 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.135427 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.142929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.142229 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:58:58.143501 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.143484 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:58:58.143583 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.143519 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:58:58.143583 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.143540 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:58:58.143682 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.143595 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:58:58.148784 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.148702 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:58:58.234986 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.234935 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.235659 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.235642 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.235760 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.235668 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.235760 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.235683 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.235760 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.235709 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.244575 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.244559 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal"] Jun 11 14:58:58.244648 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.244610 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.245272 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.245257 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.245343 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.245283 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.245343 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.245298 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.246383 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.246370 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.246497 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.246484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.246536 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.246510 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.247030 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247013 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.247097 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247040 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.247097 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247049 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.247173 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247017 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.247173 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247118 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.247173 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.247132 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.248378 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.248357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.248448 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.248400 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:58.249096 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.249081 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:58.249188 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.249109 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:58.249188 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.249119 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:58.249629 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.249606 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.249629 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.249627 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-43.ec2.internal\": node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.268688 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.268669 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.274287 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.274271 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-43.ec2.internal\" not found" node="ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.278507 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.278492 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-43.ec2.internal\" not found" node="ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.369365 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.369334 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.375648 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.375627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.375753 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.375656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.375753 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.375681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7241390d053b204124a3c33452facecb-config\") pod \"kube-apiserver-proxy-ip-10-0-128-43.ec2.internal\" (UID: \"7241390d053b204124a3c33452facecb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.469794 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.469763 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.476129 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.476177 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.476177 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7241390d053b204124a3c33452facecb-config\") pod \"kube-apiserver-proxy-ip-10-0-128-43.ec2.internal\" (UID: \"7241390d053b204124a3c33452facecb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.476269 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476179 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7241390d053b204124a3c33452facecb-config\") pod \"kube-apiserver-proxy-ip-10-0-128-43.ec2.internal\" (UID: \"7241390d053b204124a3c33452facecb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.476269 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.476269 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.476231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/192e9383755450e71de02ab66c5dd0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal\" (UID: \"192e9383755450e71de02ab66c5dd0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.570522 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.570469 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.578929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.578908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.583031 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:58.582742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:58.670582 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.670555 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.771126 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.771103 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.871706 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.871650 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:58.972226 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:58.972206 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:59.003642 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.003624 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:58:59.004194 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.003791 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:58:59.072837 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:59.072813 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:59.090186 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:59.090003 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192e9383755450e71de02ab66c5dd0b7.slice/crio-526bbc05c9a4ed6b8ed8cf4e8f07f5e3bbd7e891594dc95fea243e7bf35361c2 WatchSource:0}: Error finding container 526bbc05c9a4ed6b8ed8cf4e8f07f5e3bbd7e891594dc95fea243e7bf35361c2: Status 404 returned error can't find the container with id 526bbc05c9a4ed6b8ed8cf4e8f07f5e3bbd7e891594dc95fea243e7bf35361c2 Jun 11 14:58:59.090411 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:58:59.090394 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7241390d053b204124a3c33452facecb.slice/crio-2b534c9195c64701e59eaec11301fb0e003bf565318e974af0dbf7e533ff08ae WatchSource:0}: Error finding container 2b534c9195c64701e59eaec11301fb0e003bf565318e974af0dbf7e533ff08ae: Status 404 returned error can't find the container with id 2b534c9195c64701e59eaec11301fb0e003bf565318e974af0dbf7e533ff08ae Jun 11 14:58:59.095305 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.094753 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:58:59.122259 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.122202 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:53:58 +0000 UTC" deadline="2028-01-22 20:17:17.705692738 +0000 UTC" Jun 11 14:58:59.122259 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.122228 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14165h18m18.583468045s" Jun 11 14:58:59.138489 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.138469 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:58:59.139213 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.139192 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:58:59.139300 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.139220 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:58:59.139300 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.139233 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:58:59.147049 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.147002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" event={"ID":"7241390d053b204124a3c33452facecb","Type":"ContainerStarted","Data":"2b534c9195c64701e59eaec11301fb0e003bf565318e974af0dbf7e533ff08ae"} Jun 11 14:58:59.148008 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.147979 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" event={"ID":"192e9383755450e71de02ab66c5dd0b7","Type":"ContainerStarted","Data":"526bbc05c9a4ed6b8ed8cf4e8f07f5e3bbd7e891594dc95fea243e7bf35361c2"} Jun 11 14:58:59.173204 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:59.173181 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:59.202992 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.202967 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:58:59.273646 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:59.273625 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:59.374160 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:58:59.374095 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-43.ec2.internal\" not found" Jun 11 14:58:59.424283 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.424259 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:58:59.475056 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.475030 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" Jun 11 14:58:59.487827 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.487805 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:58:59.488737 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.488709 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" Jun 11 14:58:59.500961 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.500947 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:58:59.521905 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:58:59.521887 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:59:00.053693 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.053660 2581 apiserver.go:52] "Watching apiserver" Jun 11 14:59:00.063755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.063016 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:59:00.063755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.063412 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-9pjv8","openshift-multus/multus-gb6j2","openshift-network-diagnostics/network-check-target-kdpjp","kube-system/konnectivity-agent-7dhjf","kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal","openshift-multus/multus-additional-cni-plugins-6qsl4","openshift-multus/network-metrics-daemon-6tmn7","openshift-network-operator/iptables-alerter-4zggf","openshift-ovn-kubernetes/ovnkube-node-ckdt2","kube-system/global-pull-secret-syncer-6f84f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf","openshift-cluster-node-tuning-operator/tuned-hxlns","openshift-dns/node-resolver-h4kw8"] Jun 11 14:59:00.065780 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.065067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.066468 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.066209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.066468 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.066306 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:00.067242 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.067222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:00.067334 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.067285 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:00.068053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068026 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.068144 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068026 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:59:00.068144 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068029 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:59:00.068525 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068512 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:59:00.068735 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068707 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m7d94\"" Jun 11 14:59:00.068896 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.068878 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.069251 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.069234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.072060 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.072041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l5bfg\"" Jun 11 14:59:00.072916 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.072897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:59:00.073142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.073126 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:59:00.073970 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.073951 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:59:00.076549 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.075558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.076916 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.076779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.076916 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.076837 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:00.078034 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.078015 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.078153 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.078139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2lwp8\"" Jun 11 14:59:00.078227 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.078158 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.078227 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.078046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.079807 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.079791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.081092 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.081071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.081181 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.081129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.083188 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.081529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.083188 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.082163 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:59:00.083188 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.083084 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.083533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-svq54\"" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.083573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.083970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2fkt4\"" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.083963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-cnibin\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcsdt\" (UniqueName: \"kubernetes.io/projected/a9baf735-9863-4078-926c-975755339d98-kube-api-access-qcsdt\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-kubelet-config\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdsk4\" (UniqueName: \"kubernetes.io/projected/be344747-fa85-4ec3-bdbf-bbe96e6938ea-kube-api-access-jdsk4\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-system-cni-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-dbus\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084367 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece181b1-40df-415f-ac91-17ac238b5423-agent-certs\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be344747-fa85-4ec3-bdbf-bbe96e6938ea-hosts-file\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be344747-fa85-4ec3-bdbf-bbe96e6938ea-tmp-dir\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.086028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084755 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5wf6k\"" Jun 11 14:59:00.086795 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-os-release\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086795 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.086795 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.084819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece181b1-40df-415f-ac91-17ac238b5423-konnectivity-ca\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.086795 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.085141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.086929 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.086836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.087957 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.087935 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:59:00.088170 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.088156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.088350 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.088327 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:59:00.089011 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.088995 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:59:00.089379 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.089362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.089633 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.089616 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:59:00.089875 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.089853 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:59:00.089953 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.089928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k7kc8\"" Jun 11 14:59:00.090010 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.089936 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.090370 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.090342 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.090629 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.090612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:59:00.090746 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.090611 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pnqn6\"" Jun 11 14:59:00.090898 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.090884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.093107 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.093090 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:59:00.093107 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.093099 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:59:00.093953 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.093937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pdx72\"" Jun 11 14:59:00.094046 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.094028 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:59:00.110551 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.110532 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gphg8" Jun 11 14:59:00.118712 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.118694 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gphg8" Jun 11 14:59:00.175682 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.175660 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:59:00.185813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-etc-kubernetes\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.185890 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-conf\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.185890 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdsk4\" (UniqueName: \"kubernetes.io/projected/be344747-fa85-4ec3-bdbf-bbe96e6938ea-kube-api-access-jdsk4\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.185890 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece181b1-40df-415f-ac91-17ac238b5423-agent-certs\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysconfig\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-sys\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.185977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-netns\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186053 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece181b1-40df-415f-ac91-17ac238b5423-konnectivity-ca\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-systemd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-var-lib-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-cnibin\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-cni-binary-copy\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-bin\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9tj\" (UniqueName: \"kubernetes.io/projected/f0e15708-f250-4748-b715-bbaac5e6838a-kube-api-access-fk9tj\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.186333 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186305 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-cnibin\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-slash\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.186428 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.186501 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:00.686478201 +0000 UTC m=+3.007779323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-dbus\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-k8s-cni-cncf-io\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ece181b1-40df-415f-ac91-17ac238b5423-konnectivity-ca\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-netns\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-multus-certs\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-node-log\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186708 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.186813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-kubernetes\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-dbus\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-kubelet\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-kubelet\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-etc-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-ovn\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-log-socket\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.186984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-socket-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzltb\" (UniqueName: \"kubernetes.io/projected/837fbe13-e170-4740-96df-9ea759ecdac5-kube-api-access-wzltb\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcsdt\" (UniqueName: \"kubernetes.io/projected/a9baf735-9863-4078-926c-975755339d98-kube-api-access-qcsdt\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-tmp\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-os-release\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-config\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-system-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-script-lib\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.187628 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvff5\" (UniqueName: \"kubernetes.io/projected/499faf90-991f-49e8-8a30-000f847b13db-kube-api-access-zvff5\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-device-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-system-cni-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-bin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187292 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-system-cni-dir\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-hostroot\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-conf-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-netd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-sys-fs\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/837fbe13-e170-4740-96df-9ea759ecdac5-host-slash\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be344747-fa85-4ec3-bdbf-bbe96e6938ea-hosts-file\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be344747-fa85-4ec3-bdbf-bbe96e6938ea-tmp-dir\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-lib-modules\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be344747-fa85-4ec3-bdbf-bbe96e6938ea-hosts-file\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-kubelet-config\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.188413 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91c6b185-0b9d-4ca5-9abb-81d8351eec75-kubelet-config\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-modprobe-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9baf735-9863-4078-926c-975755339d98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntxbv\" (UniqueName: \"kubernetes.io/projected/c88f0c4e-2887-49d6-8e79-25133e639f9f-kube-api-access-ntxbv\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/499faf90-991f-49e8-8a30-000f847b13db-ovn-node-metrics-cert\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-registration-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/837fbe13-e170-4740-96df-9ea759ecdac5-iptables-alerter-script\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpjhp\" (UniqueName: \"kubernetes.io/projected/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-kube-api-access-fpjhp\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187919 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be344747-fa85-4ec3-bdbf-bbe96e6938ea-tmp-dir\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-tuned\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.187991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv9ff\" (UniqueName: \"kubernetes.io/projected/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-kube-api-access-vv9ff\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-socket-dir-parent\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-daemon-config\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-env-overrides\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.189193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-systemd-units\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-os-release\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxxvm\" (UniqueName: \"kubernetes.io/projected/2f58024c-62a7-451e-84c4-ab34eb1a5e97-kube-api-access-wxxvm\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-run\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-var-lib-kubelet\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-multus\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-host\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-cnibin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-systemd\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-host\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-serviceca\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.190052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.188197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9baf735-9863-4078-926c-975755339d98-os-release\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.190620 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.190119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ece181b1-40df-415f-ac91-17ac238b5423-agent-certs\") pod \"konnectivity-agent-7dhjf\" (UID: \"ece181b1-40df-415f-ac91-17ac238b5423\") " pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.196318 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.196296 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:00.196453 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.196327 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:00.196453 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.196342 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:00.196453 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.196404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:00.696387829 +0000 UTC m=+3.017688946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:00.196453 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.196415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdsk4\" (UniqueName: \"kubernetes.io/projected/be344747-fa85-4ec3-bdbf-bbe96e6938ea-kube-api-access-jdsk4\") pod \"node-resolver-h4kw8\" (UID: \"be344747-fa85-4ec3-bdbf-bbe96e6938ea\") " pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.198461 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.198436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcsdt\" (UniqueName: \"kubernetes.io/projected/a9baf735-9863-4078-926c-975755339d98-kube-api-access-qcsdt\") pod \"multus-additional-cni-plugins-6qsl4\" (UID: \"a9baf735-9863-4078-926c-975755339d98\") " pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.288641 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.288641 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-modprobe-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntxbv\" (UniqueName: \"kubernetes.io/projected/c88f0c4e-2887-49d6-8e79-25133e639f9f-kube-api-access-ntxbv\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-modprobe-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288800 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-d\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.288853 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/499faf90-991f-49e8-8a30-000f847b13db-ovn-node-metrics-cert\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-registration-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/837fbe13-e170-4740-96df-9ea759ecdac5-iptables-alerter-script\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpjhp\" (UniqueName: \"kubernetes.io/projected/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-kube-api-access-fpjhp\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-registration-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.288991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-tuned\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv9ff\" (UniqueName: \"kubernetes.io/projected/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-kube-api-access-vv9ff\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-socket-dir-parent\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-daemon-config\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289142 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-socket-dir-parent\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-env-overrides\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-systemd-units\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxxvm\" (UniqueName: \"kubernetes.io/projected/2f58024c-62a7-451e-84c4-ab34eb1a5e97-kube-api-access-wxxvm\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-run\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-var-lib-kubelet\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-multus\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-systemd-units\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-host\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-cnibin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-var-lib-kubelet\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-systemd\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-host\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-serviceca\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-etc-kubernetes\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-cnibin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-conf\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.289755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289567 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/837fbe13-e170-4740-96df-9ea759ecdac5-iptables-alerter-script\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysconfig\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-daemon-config\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-sys\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-host\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-netns\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289658 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysctl-conf\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-systemd\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-systemd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-env-overrides\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289748 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-run\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289759 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-host\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289799 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-etc-kubernetes\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-systemd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-sysconfig\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-var-lib-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.290614 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-sys\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-multus\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-var-lib-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289927 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-run-netns\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.289895 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.289982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.290004 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:00.789990868 +0000 UTC m=+3.111291970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-cni-binary-copy\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-bin\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-etc-selinux\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9tj\" (UniqueName: \"kubernetes.io/projected/f0e15708-f250-4748-b715-bbaac5e6838a-kube-api-access-fk9tj\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-slash\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.291442 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-bin\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-k8s-cni-cncf-io\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-netns\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-multus-certs\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-node-log\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-serviceca\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290312 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-netns\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-kubernetes\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-multus-certs\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-run-k8s-cni-cncf-io\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-node-log\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-kubernetes\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-kubelet\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-kubelet\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88f0c4e-2887-49d6-8e79-25133e639f9f-cni-binary-copy\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-etc-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290501 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-kubelet\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290503 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-kubelet\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-ovn\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-slash\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-etc-openvswitch\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-log-socket\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290564 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-log-socket\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-run-ovn\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-socket-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzltb\" (UniqueName: \"kubernetes.io/projected/837fbe13-e170-4740-96df-9ea759ecdac5-kube-api-access-wzltb\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-tmp\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-os-release\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-config\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-system-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-socket-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-script-lib\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvff5\" (UniqueName: \"kubernetes.io/projected/499faf90-991f-49e8-8a30-000f847b13db-kube-api-access-zvff5\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-device-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-bin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.292611 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-hostroot\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290863 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-os-release\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-conf-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-device-dir\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-netd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-sys-fs\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.290974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/837fbe13-e170-4740-96df-9ea759ecdac5-host-slash\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-lib-modules\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-lib-modules\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-host-var-lib-cni-bin\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-config\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-hostroot\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-system-cni-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88f0c4e-2887-49d6-8e79-25133e639f9f-multus-conf-dir\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0e15708-f250-4748-b715-bbaac5e6838a-sys-fs\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/837fbe13-e170-4740-96df-9ea759ecdac5-host-slash\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291366 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/499faf90-991f-49e8-8a30-000f847b13db-host-cni-netd\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/499faf90-991f-49e8-8a30-000f847b13db-ovnkube-script-lib\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.293321 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/499faf90-991f-49e8-8a30-000f847b13db-ovn-node-metrics-cert\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.293959 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.291763 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-etc-tuned\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.293959 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.293150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-tmp\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.297462 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.297379 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv9ff\" (UniqueName: \"kubernetes.io/projected/1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69-kube-api-access-vv9ff\") pod \"tuned-hxlns\" (UID: \"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69\") " pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.297462 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.297421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpjhp\" (UniqueName: \"kubernetes.io/projected/28a8b668-bbc6-49ca-b054-8a4f1b1b4a47-kube-api-access-fpjhp\") pod \"node-ca-9pjv8\" (UID: \"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47\") " pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.298342 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.298315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntxbv\" (UniqueName: \"kubernetes.io/projected/c88f0c4e-2887-49d6-8e79-25133e639f9f-kube-api-access-ntxbv\") pod \"multus-gb6j2\" (UID: \"c88f0c4e-2887-49d6-8e79-25133e639f9f\") " pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.298517 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.298489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxxvm\" (UniqueName: \"kubernetes.io/projected/2f58024c-62a7-451e-84c4-ab34eb1a5e97-kube-api-access-wxxvm\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.299679 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.299654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9tj\" (UniqueName: \"kubernetes.io/projected/f0e15708-f250-4748-b715-bbaac5e6838a-kube-api-access-fk9tj\") pod \"aws-ebs-csi-driver-node-sfnpf\" (UID: \"f0e15708-f250-4748-b715-bbaac5e6838a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.299822 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.299807 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzltb\" (UniqueName: \"kubernetes.io/projected/837fbe13-e170-4740-96df-9ea759ecdac5-kube-api-access-wzltb\") pod \"iptables-alerter-4zggf\" (UID: \"837fbe13-e170-4740-96df-9ea759ecdac5\") " pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.299958 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.299936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvff5\" (UniqueName: \"kubernetes.io/projected/499faf90-991f-49e8-8a30-000f847b13db-kube-api-access-zvff5\") pod \"ovnkube-node-ckdt2\" (UID: \"499faf90-991f-49e8-8a30-000f847b13db\") " pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.380066 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.379958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" Jun 11 14:59:00.388028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.388007 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:00.396681 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.396659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4kw8" Jun 11 14:59:00.402406 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.402386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zggf" Jun 11 14:59:00.408018 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.407999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxlns" Jun 11 14:59:00.414462 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.414442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gb6j2" Jun 11 14:59:00.420041 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.420023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:00.427486 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.427470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9pjv8" Jun 11 14:59:00.433067 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.433051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" Jun 11 14:59:00.558912 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.558885 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:59:00.693794 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.693747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:00.693942 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.693868 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:00.693942 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.693937 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:01.693916015 +0000 UTC m=+4.015217134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:00.794796 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.794766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:00.794945 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:00.794845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:00.795016 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.794945 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:00.795016 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.794961 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:00.795016 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.794973 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:00.795016 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.794984 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:00.795016 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.795012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:01.794995349 +0000 UTC m=+4.116296463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:00.795214 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:00.795028 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:01.795020149 +0000 UTC m=+4.116321258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:01.061419 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.061378 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece181b1_40df_415f_ac91_17ac238b5423.slice/crio-25b0dff66edebd067ec880347fba350a141d990e62a9cae52cc5a9fcc95883f2 WatchSource:0}: Error finding container 25b0dff66edebd067ec880347fba350a141d990e62a9cae52cc5a9fcc95883f2: Status 404 returned error can't find the container with id 25b0dff66edebd067ec880347fba350a141d990e62a9cae52cc5a9fcc95883f2 Jun 11 14:59:01.063044 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.062995 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9baf735_9863_4078_926c_975755339d98.slice/crio-580e473084e0dfdbf4ffb959c6c86485273832e0c588cb18dbbd31df9dcbd2ac WatchSource:0}: Error finding container 580e473084e0dfdbf4ffb959c6c86485273832e0c588cb18dbbd31df9dcbd2ac: Status 404 returned error can't find the container with id 580e473084e0dfdbf4ffb959c6c86485273832e0c588cb18dbbd31df9dcbd2ac Jun 11 14:59:01.063281 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.063258 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7a5a62_2eeb_4f4c_8a43_9f408b1a7c69.slice/crio-477f23a2325a2c31fc7c6a16d9a81ec67887a51aa2cf9ec560c043e1da5d9524 WatchSource:0}: Error finding container 477f23a2325a2c31fc7c6a16d9a81ec67887a51aa2cf9ec560c043e1da5d9524: Status 404 returned error can't find the container with id 477f23a2325a2c31fc7c6a16d9a81ec67887a51aa2cf9ec560c043e1da5d9524 Jun 11 14:59:01.067837 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.067818 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88f0c4e_2887_49d6_8e79_25133e639f9f.slice/crio-6f7067f272f00dbcc002d2257a8084956ee433a1c0f74a04e85f32ab70a50aca WatchSource:0}: Error finding container 6f7067f272f00dbcc002d2257a8084956ee433a1c0f74a04e85f32ab70a50aca: Status 404 returned error can't find the container with id 6f7067f272f00dbcc002d2257a8084956ee433a1c0f74a04e85f32ab70a50aca Jun 11 14:59:01.068632 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.068608 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499faf90_991f_49e8_8a30_000f847b13db.slice/crio-026a917e98f44d8f99daee112f8c265ba52b6075072fcfa63623886af37e123a WatchSource:0}: Error finding container 026a917e98f44d8f99daee112f8c265ba52b6075072fcfa63623886af37e123a: Status 404 returned error can't find the container with id 026a917e98f44d8f99daee112f8c265ba52b6075072fcfa63623886af37e123a Jun 11 14:59:01.078041 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.078017 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a8b668_bbc6_49ca_b054_8a4f1b1b4a47.slice/crio-543a2d00b24a67f5e207c6079aa147286a6147c76d73da1b5f6ca834f71b1964 WatchSource:0}: Error finding container 543a2d00b24a67f5e207c6079aa147286a6147c76d73da1b5f6ca834f71b1964: Status 404 returned error can't find the container with id 543a2d00b24a67f5e207c6079aa147286a6147c76d73da1b5f6ca834f71b1964 Jun 11 14:59:01.078917 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:01.078894 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e15708_f250_4748_b715_bbaac5e6838a.slice/crio-4776f41573d091c1aa823406b52563e65539cbe9b452919be4ac95f1d0ca64f1 WatchSource:0}: Error finding container 4776f41573d091c1aa823406b52563e65539cbe9b452919be4ac95f1d0ca64f1: Status 404 returned error can't find the container with id 4776f41573d091c1aa823406b52563e65539cbe9b452919be4ac95f1d0ca64f1 Jun 11 14:59:01.121395 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.121311 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:54:00 +0000 UTC" deadline="2028-03-01 02:41:23.692555296 +0000 UTC" Jun 11 14:59:01.121395 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.121346 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15083h42m22.571212258s" Jun 11 14:59:01.151475 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.151447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerStarted","Data":"580e473084e0dfdbf4ffb959c6c86485273832e0c588cb18dbbd31df9dcbd2ac"} Jun 11 14:59:01.152489 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.152472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dhjf" event={"ID":"ece181b1-40df-415f-ac91-17ac238b5423","Type":"ContainerStarted","Data":"25b0dff66edebd067ec880347fba350a141d990e62a9cae52cc5a9fcc95883f2"} Jun 11 14:59:01.153509 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.153490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zggf" event={"ID":"837fbe13-e170-4740-96df-9ea759ecdac5","Type":"ContainerStarted","Data":"66a6ff5db1bc1c398cadcdd7215d8f5017d94ebf72395253beb447fdae8bfb11"} Jun 11 14:59:01.154702 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.154680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4kw8" event={"ID":"be344747-fa85-4ec3-bdbf-bbe96e6938ea","Type":"ContainerStarted","Data":"5c065c6e7dcd8f320662662cc2a28452e293cde8a26d0a0ed37ac4549190a799"} Jun 11 14:59:01.155748 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.155711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"026a917e98f44d8f99daee112f8c265ba52b6075072fcfa63623886af37e123a"} Jun 11 14:59:01.156913 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.156876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxlns" event={"ID":"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69","Type":"ContainerStarted","Data":"477f23a2325a2c31fc7c6a16d9a81ec67887a51aa2cf9ec560c043e1da5d9524"} Jun 11 14:59:01.157954 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.157926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" event={"ID":"f0e15708-f250-4748-b715-bbaac5e6838a","Type":"ContainerStarted","Data":"4776f41573d091c1aa823406b52563e65539cbe9b452919be4ac95f1d0ca64f1"} Jun 11 14:59:01.159052 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.159031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9pjv8" event={"ID":"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47","Type":"ContainerStarted","Data":"543a2d00b24a67f5e207c6079aa147286a6147c76d73da1b5f6ca834f71b1964"} Jun 11 14:59:01.160224 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.160202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gb6j2" event={"ID":"c88f0c4e-2887-49d6-8e79-25133e639f9f","Type":"ContainerStarted","Data":"6f7067f272f00dbcc002d2257a8084956ee433a1c0f74a04e85f32ab70a50aca"} Jun 11 14:59:01.701299 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.700715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:01.701299 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.700899 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:01.701299 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.700961 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:03.700943364 +0000 UTC m=+6.022244470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:01.801732 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.801675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:01.801916 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:01.801781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:01.801916 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.801907 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:01.802026 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.801926 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:01.802026 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.801938 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:01.802026 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.801991 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:03.8019733 +0000 UTC m=+6.123274417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:01.802384 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.802365 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:01.802479 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:01.802416 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:03.802401686 +0000 UTC m=+6.123702807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:02.121602 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.121489 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:54:00 +0000 UTC" deadline="2028-02-08 04:56:01.084411685 +0000 UTC" Jun 11 14:59:02.121602 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.121523 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14557h56m58.962893862s" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.144183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.144183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:02.144296 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.144327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:02.144413 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:02.144621 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:02.144495 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:02.171956 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.171782 2581 generic.go:356] "Generic (PLEG): container finished" podID="192e9383755450e71de02ab66c5dd0b7" containerID="2cc106fadab2637fddeb0bf34d40904fb57dbf67aa1f5e1128d02d0041bfc53d" exitCode=0 Jun 11 14:59:02.171956 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.171872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" event={"ID":"192e9383755450e71de02ab66c5dd0b7","Type":"ContainerDied","Data":"2cc106fadab2637fddeb0bf34d40904fb57dbf67aa1f5e1128d02d0041bfc53d"} Jun 11 14:59:02.180813 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:02.180785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" event={"ID":"7241390d053b204124a3c33452facecb","Type":"ContainerStarted","Data":"2cffa559265b305c21157e8b8317239b95bb0fed772f3893281d69bc04c5ebfa"} Jun 11 14:59:03.206635 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.205788 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" event={"ID":"192e9383755450e71de02ab66c5dd0b7","Type":"ContainerStarted","Data":"96e985f4f96e3f3125497c1b5f5310719bdd2c620de38a31745e3d3c250bf686"} Jun 11 14:59:03.225608 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.225557 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-43.ec2.internal" podStartSLOduration=4.225537983 podStartE2EDuration="4.225537983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:02.203962573 +0000 UTC m=+4.525263696" watchObservedRunningTime="2026-06-11 14:59:03.225537983 +0000 UTC m=+5.546839130" Jun 11 14:59:03.225769 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.225639 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-43.ec2.internal" podStartSLOduration=4.225634433 podStartE2EDuration="4.225634433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:03.225021939 +0000 UTC m=+5.546323061" watchObservedRunningTime="2026-06-11 14:59:03.225634433 +0000 UTC m=+5.546935557" Jun 11 14:59:03.722185 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.721569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:03.722185 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.721710 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:03.722185 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.721792 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:07.721762756 +0000 UTC m=+10.043063860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.822686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:03.822755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.822900 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.822956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:07.822937959 +0000 UTC m=+10.144239063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.823331 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.823353 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.823364 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:03.823521 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:03.823407 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:07.823392497 +0000 UTC m=+10.144693602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:04.145857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:04.145873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:04.145974 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:04.145990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:04.146096 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:04.146349 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:04.146161 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:06.144457 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:06.144424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:06.144919 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:06.144463 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:06.144919 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:06.144432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:06.144919 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:06.144555 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:06.144919 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:06.144666 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:06.144919 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:06.144761 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:07.752543 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:07.752005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:07.752543 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.752151 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:07.752543 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.752215 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:15.752198278 +0000 UTC m=+18.073499383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:07.852352 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:07.852312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:07.852501 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:07.852397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:07.852550 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852518 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:07.852550 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852532 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:07.852550 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852541 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:07.852649 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852549 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:07.852649 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:15.852575756 +0000 UTC m=+18.173876856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:07.852649 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:07.852611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:15.852593942 +0000 UTC m=+18.173895046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:08.146859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:08.146879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:08.146977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:08.147893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:08.147976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:08.148410 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:08.148056 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:10.143818 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:10.143778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:10.144343 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:10.143907 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:10.144343 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:10.144267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:10.144493 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:10.144354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:10.144553 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:10.144494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:10.144636 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:10.144590 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:12.144825 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:12.144793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:12.145235 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:12.144804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:12.145235 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:12.144932 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:12.145235 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:12.144969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:12.145235 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:12.145045 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:12.145235 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:12.145117 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:14.144098 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:14.143899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:14.144477 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:14.144188 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:14.144477 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:14.143938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:14.144477 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:14.144252 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:14.144477 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:14.143903 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:14.144477 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:14.144310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:15.813876 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:15.813843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:15.814317 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.813982 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:15.814317 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.814030 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:31.814017592 +0000 UTC m=+34.135318693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:15.914572 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:15.914533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:15.914572 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:15.914578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:15.914773 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914714 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:15.914773 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914740 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:15.914773 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914758 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:15.914773 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914769 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:15.914918 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914789 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:31.91477134 +0000 UTC m=+34.236072446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:15.914918 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:15.914804 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 14:59:31.914794487 +0000 UTC m=+34.236095606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:16.144527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:16.144547 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:16.144652 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:16.144666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:16.144801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:16.145039 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:16.144879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:18.144916 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:18.144890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:18.145325 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:18.144979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:18.145325 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:18.144986 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:18.145325 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:18.145116 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:18.145325 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:18.145141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:18.145325 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:18.145184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:20.144035 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.143904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:20.144629 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.143911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:20.144629 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:20.144137 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:20.144629 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.143911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:20.144629 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:20.144174 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:20.144629 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:20.144238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:20.236186 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.236165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" event={"ID":"f0e15708-f250-4748-b715-bbaac5e6838a","Type":"ContainerStarted","Data":"fc2e9881de73e3c63fb2d5b938057613df3ecb624e86eb6cc63110b085f0a2dd"} Jun 11 14:59:20.237384 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.237364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9pjv8" event={"ID":"28a8b668-bbc6-49ca-b054-8a4f1b1b4a47","Type":"ContainerStarted","Data":"fd8e4d68aa8f6c14b28a96b0983a2da901fcdc71379b69294098b5c2ffbf675d"} Jun 11 14:59:20.238845 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.238823 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gb6j2" event={"ID":"c88f0c4e-2887-49d6-8e79-25133e639f9f","Type":"ContainerStarted","Data":"fd4eaf03d19ccf1b57a2885514246d6896a72f32b5e7518e65e5da38e7d42684"} Jun 11 14:59:20.240111 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.240090 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="88e03f2df55607913f28ffc48f443fca6a58e4dec8dabda66d247f533e0af31b" exitCode=0 Jun 11 14:59:20.240193 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.240148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"88e03f2df55607913f28ffc48f443fca6a58e4dec8dabda66d247f533e0af31b"} Jun 11 14:59:20.241605 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.241579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7dhjf" event={"ID":"ece181b1-40df-415f-ac91-17ac238b5423","Type":"ContainerStarted","Data":"bd50acd733e21ad55dcf603f0afa8d4069af92d794d4624c45402cb2e4f519dc"} Jun 11 14:59:20.245504 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.245486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4kw8" event={"ID":"be344747-fa85-4ec3-bdbf-bbe96e6938ea","Type":"ContainerStarted","Data":"04bd5b7c593c255f1d8922e1cdaa9a75e04f54033533b4e739e9e22e036e741a"} Jun 11 14:59:20.247710 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.247693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 14:59:20.248050 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248028 2581 generic.go:356] "Generic (PLEG): container finished" podID="499faf90-991f-49e8-8a30-000f847b13db" containerID="3af9e1d316367c358026bbbe75eac00bfd14649a32c6ab8b87579aef5fbb98b9" exitCode=1 Jun 11 14:59:20.248138 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"e7c99dae259bdc8f59f9e6ebf343c4b7b9fc128faff807fef5b465444930097f"} Jun 11 14:59:20.248191 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"5f498b817960e839c536a55e7d21bcb9499ef68bed6d964f40621d0cb531fe8d"} Jun 11 14:59:20.248191 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"6fb1ea742a6aa803effbad60776f6e1d228a9e3c50fa7f2c0914e3fcec685a41"} Jun 11 14:59:20.248263 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerDied","Data":"3af9e1d316367c358026bbbe75eac00bfd14649a32c6ab8b87579aef5fbb98b9"} Jun 11 14:59:20.248263 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.248242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"c4001649b4a498112bb2bd1d81093d53b2fb3a517e687991b245d86db0b81dc1"} Jun 11 14:59:20.249473 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.249448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxlns" event={"ID":"1f7a5a62-2eeb-4f4c-8a43-9f408b1a7c69","Type":"ContainerStarted","Data":"e8048c466f1486372b3191db3c186872b1425dd02bbe86293871240792df743b"} Jun 11 14:59:20.254260 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.254226 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9pjv8" podStartSLOduration=3.789383038 podStartE2EDuration="22.254214174s" totalImagesPullingTime="18.464831136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:20.25412998 +0000 UTC m=+22.575431093" watchObservedRunningTime="2026-06-11 14:59:20.254214174 +0000 UTC m=+22.575515295" Jun 11 14:59:20.292274 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.292226 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7dhjf" podStartSLOduration=8.329761599 podStartE2EDuration="22.29221502s" totalImagesPullingTime="13.962453421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:20.292205483 +0000 UTC m=+22.613506604" watchObservedRunningTime="2026-06-11 14:59:20.29221502 +0000 UTC m=+22.613516139" Jun 11 14:59:20.306253 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.306193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h4kw8" podStartSLOduration=3.810668611 podStartE2EDuration="22.306183047s" totalImagesPullingTime="18.495514436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:20.305681609 +0000 UTC m=+22.626982732" watchObservedRunningTime="2026-06-11 14:59:20.306183047 +0000 UTC m=+22.627484168" Jun 11 14:59:20.321192 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:20.321159 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gb6j2" podStartSLOduration=3.778830423 podStartE2EDuration="22.321148161s" totalImagesPullingTime="18.542317738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:20.321148596 +0000 UTC m=+22.642449721" watchObservedRunningTime="2026-06-11 14:59:20.321148161 +0000 UTC m=+22.642449283" Jun 11 14:59:21.255372 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.255346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 14:59:21.255910 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.255883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"5a724e55361279c676e780715533ff1a4b72e8541b309394c7f512ff003badd2"} Jun 11 14:59:21.257623 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.257599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zggf" event={"ID":"837fbe13-e170-4740-96df-9ea759ecdac5","Type":"ContainerStarted","Data":"a74ba3bc37eed40f25f6a5842b3284b2912a773eadd474bcef9c7bbd14aa962a"} Jun 11 14:59:21.273588 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.273543 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hxlns" podStartSLOduration=4.769625785 podStartE2EDuration="23.2735239s" totalImagesPullingTime="18.503898115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:20.337308292 +0000 UTC m=+22.658609414" watchObservedRunningTime="2026-06-11 14:59:21.2735239 +0000 UTC m=+23.594825023" Jun 11 14:59:21.274359 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.274325 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4zggf" podStartSLOduration=4.758595723 podStartE2EDuration="23.274315645s" totalImagesPullingTime="18.515719922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:21.273696547 +0000 UTC m=+23.594997668" watchObservedRunningTime="2026-06-11 14:59:21.274315645 +0000 UTC m=+23.595616765" Jun 11 14:59:21.324566 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.324547 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:59:21.832324 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.832276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:21.832866 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:21.832674 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:22.146610 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.146583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:22.146757 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:22.146716 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:22.147125 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.147108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:22.147216 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:22.147197 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:22.147277 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.147257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:22.147333 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:22.147317 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:22.148071 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.147387 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:59:21.324562851Z","UUID":"f258d013-2c48-4ae3-8f9b-d6a59d4635de","Handler":null,"Name":"","Endpoint":""} Jun 11 14:59:22.150829 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.150799 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:59:22.150924 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.150852 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:59:22.261701 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.261670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" event={"ID":"f0e15708-f250-4748-b715-bbaac5e6838a","Type":"ContainerStarted","Data":"321e4fdd05ab087ca23f88bc20813a0442b802db862a5003b23f805bcdeef390"} Jun 11 14:59:22.262255 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.261746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" event={"ID":"f0e15708-f250-4748-b715-bbaac5e6838a","Type":"ContainerStarted","Data":"9059156bd9d55055ddfb3a7a4e62cd3b82eb9ec3376c3bc0c8868a0e839a345f"} Jun 11 14:59:22.262255 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.261929 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:22.262473 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.262459 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7dhjf" Jun 11 14:59:22.279590 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:22.279545 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sfnpf" podStartSLOduration=3.6810738990000003 podStartE2EDuration="24.279534128s" totalImagesPullingTime="20.598460229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:22.279092981 +0000 UTC m=+24.600394104" watchObservedRunningTime="2026-06-11 14:59:22.279534128 +0000 UTC m=+24.600835249" Jun 11 14:59:23.267815 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:23.267793 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 14:59:23.268362 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:23.268265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"510b29fb26c9701bf4d4778be1b0a0672dd64f9d2df82cac1751844e0be9df41"} Jun 11 14:59:24.144601 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:24.144570 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:24.144601 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:24.144583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:24.144601 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:24.144571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:24.144861 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:24.144691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:24.144861 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:24.144810 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:24.144976 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:24.144888 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:25.274145 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.273981 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="d59f564f76b856a3af0b84fc936a9c12ac3b63e802b1a5e2c7bf0f77beba4c5f" exitCode=0 Jun 11 14:59:25.274622 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.274069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"d59f564f76b856a3af0b84fc936a9c12ac3b63e802b1a5e2c7bf0f77beba4c5f"} Jun 11 14:59:25.277528 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.277508 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 14:59:25.277840 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.277809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"b9897c37ef7d85e71d0a3a8eb9cf2fb7cd4bee85e843f968a0f924f508f836b8"} Jun 11 14:59:25.278063 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.278041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:25.278164 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.278092 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:25.278286 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.278230 2581 scope.go:117] "RemoveContainer" containerID="3af9e1d316367c358026bbbe75eac00bfd14649a32c6ab8b87579aef5fbb98b9" Jun 11 14:59:25.294058 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:25.294038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:26.144515 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.144324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:26.144668 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.144599 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:26.144668 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.144387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:26.144668 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.144324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:26.144848 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.144685 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:26.144848 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.144783 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:26.285517 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.285444 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="dba80575b91901ddf9f47643ef3d6df1ed9834416b99f53247f299188713a47a" exitCode=0 Jun 11 14:59:26.285918 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.285548 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"dba80575b91901ddf9f47643ef3d6df1ed9834416b99f53247f299188713a47a"} Jun 11 14:59:26.289765 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.289739 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 14:59:26.290124 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.290099 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" event={"ID":"499faf90-991f-49e8-8a30-000f847b13db","Type":"ContainerStarted","Data":"a0157a0764dde0a3cb5b00724db50cd8ae246a20decbf95f821856b0ae2a9a4f"} Jun 11 14:59:26.290447 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.290434 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:26.304956 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.304939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:26.337104 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.337067 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" podStartSLOduration=9.758497404 podStartE2EDuration="28.337055018s" totalImagesPullingTime="18.578557614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:26.336911272 +0000 UTC m=+28.658212394" watchObservedRunningTime="2026-06-11 14:59:26.337055018 +0000 UTC m=+28.658356136" Jun 11 14:59:26.751557 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.751523 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6f84f"] Jun 11 14:59:26.751744 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.751632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:26.751808 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.751750 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:26.754894 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.754666 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdpjp"] Jun 11 14:59:26.754894 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.754792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:26.754894 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.754860 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:26.755531 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.755505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tmn7"] Jun 11 14:59:26.755626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:26.755603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:26.755701 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:26.755678 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:27.294544 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:27.294516 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="71af294adcc26013b1d818cb06fe316b8e288c45f9c345802b4bde87e7e6c8d3" exitCode=0 Jun 11 14:59:27.294895 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:27.294589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"71af294adcc26013b1d818cb06fe316b8e288c45f9c345802b4bde87e7e6c8d3"} Jun 11 14:59:28.146232 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:28.146203 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:28.146436 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:28.146412 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:28.146820 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:28.146801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:28.146936 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:28.146918 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:28.146999 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:28.146981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:28.147109 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:28.147093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:30.143827 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:30.143788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:30.143827 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:30.143821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:30.144579 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:30.143791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:30.144579 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:30.143904 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:30.144579 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:30.143996 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:30.144579 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:30.144106 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:31.833518 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:31.833346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:31.833822 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.833469 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:31.833822 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.833581 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret podName:91c6b185-0b9d-4ca5-9abb-81d8351eec75 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:03.83356781 +0000 UTC m=+66.154868911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret") pod "global-pull-secret-syncer-6f84f" (UID: "91c6b185-0b9d-4ca5-9abb-81d8351eec75") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:59:31.934186 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:31.934165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:31.934302 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:31.934214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:31.934346 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934303 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:59:31.934346 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934302 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:31.934346 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934317 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:59:31.934346 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934327 2581 projected.go:196] Error preparing data for projected volume kube-api-access-txzcn for pod openshift-network-diagnostics/network-check-target-kdpjp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:31.934459 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934362 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs podName:2f58024c-62a7-451e-84c4-ab34eb1a5e97 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:03.934346228 +0000 UTC m=+66.255647336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs") pod "network-metrics-daemon-6tmn7" (UID: "2f58024c-62a7-451e-84c4-ab34eb1a5e97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:59:31.934459 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:31.934382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn podName:5e95d162-47e4-4741-ab66-fd3fcbf4302d nodeName:}" failed. No retries permitted until 2026-06-11 15:00:03.934371534 +0000 UTC m=+66.255672640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-txzcn" (UniqueName: "kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn") pod "network-check-target-kdpjp" (UID: "5e95d162-47e4-4741-ab66-fd3fcbf4302d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:59:32.147285 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.147261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:32.147430 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.147343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:32.147491 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.147345 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kdpjp" podUID="5e95d162-47e4-4741-ab66-fd3fcbf4302d" Jun 11 14:59:32.147491 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.147451 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tmn7" podUID="2f58024c-62a7-451e-84c4-ab34eb1a5e97" Jun 11 14:59:32.147491 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.147465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:32.147588 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.147537 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6f84f" podUID="91c6b185-0b9d-4ca5-9abb-81d8351eec75" Jun 11 14:59:32.307187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.307146 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="e292eb7a8e90a5d100486af777bb3947a4d1b6210a0e8e8747c81f3f573f0ffe" exitCode=0 Jun 11 14:59:32.307295 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.307199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"e292eb7a8e90a5d100486af777bb3947a4d1b6210a0e8e8747c81f3f573f0ffe"} Jun 11 14:59:32.533059 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.533036 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-43.ec2.internal" event="NodeReady" Jun 11 14:59:32.533176 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.533144 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:59:32.567507 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.567478 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 14:59:32.583939 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.583919 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 14:59:32.584026 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.584000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.586770 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.586750 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mdk6s"] Jun 11 14:59:32.587511 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.587116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 14:59:32.587511 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.587354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8h69h\"" Jun 11 14:59:32.587511 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.587430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 14:59:32.587815 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.587557 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 14:59:32.595791 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.594196 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 14:59:32.604714 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.604696 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vs4hg"] Jun 11 14:59:32.604821 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.604805 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.607347 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.607329 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:59:32.607347 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.607329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmhvb\"" Jun 11 14:59:32.607534 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.607461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:59:32.619617 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.619601 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vs4hg"] Jun 11 14:59:32.619705 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.619623 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mdk6s"] Jun 11 14:59:32.619705 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.619685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.622525 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.622509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:59:32.622620 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.622534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmb6r\"" Jun 11 14:59:32.622683 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.622625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:59:32.622683 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.622670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:59:32.740261 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740261 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97t9c\" (UniqueName: \"kubernetes.io/projected/1a07253d-7012-4851-a956-67fe73f789d8-kube-api-access-97t9c\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.740261 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf34254-ea68-4c23-9a41-e45238392b35-config-volume\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kfkx\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkbb\" (UniqueName: \"kubernetes.io/projected/1bf34254-ea68-4c23-9a41-e45238392b35-kube-api-access-zxkbb\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a07253d-7012-4851-a956-67fe73f789d8-cert\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.740450 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.740626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.740626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf34254-ea68-4c23-9a41-e45238392b35-tmp-dir\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.740626 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.740601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.841712 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.841712 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97t9c\" (UniqueName: \"kubernetes.io/projected/1a07253d-7012-4851-a956-67fe73f789d8-kube-api-access-97t9c\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf34254-ea68-4c23-9a41-e45238392b35-config-volume\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kfkx\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkbb\" (UniqueName: \"kubernetes.io/projected/1bf34254-ea68-4c23-9a41-e45238392b35-kube-api-access-zxkbb\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a07253d-7012-4851-a956-67fe73f789d8-cert\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.841989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842187 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf34254-ea68-4c23-9a41-e45238392b35-tmp-dir\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.842317 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.842386 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:33.342368097 +0000 UTC m=+35.663669211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842432 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf34254-ea68-4c23-9a41-e45238392b35-config-volume\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842482 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf34254-ea68-4c23-9a41-e45238392b35-tmp-dir\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.842519 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.842532 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:32.842586 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:33.342569756 +0000 UTC m=+35.663870873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:32.842784 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.842597 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.843351 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.843329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.846205 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.846183 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.846302 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.846206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a07253d-7012-4851-a956-67fe73f789d8-cert\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.846302 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.846184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.850814 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.850780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkbb\" (UniqueName: \"kubernetes.io/projected/1bf34254-ea68-4c23-9a41-e45238392b35-kube-api-access-zxkbb\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:32.850814 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.850809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.851222 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.851200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97t9c\" (UniqueName: \"kubernetes.io/projected/1a07253d-7012-4851-a956-67fe73f789d8-kube-api-access-97t9c\") pod \"ingress-canary-vs4hg\" (UID: \"1a07253d-7012-4851-a956-67fe73f789d8\") " pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:32.851309 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.851286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kfkx\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:32.927412 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:32.927390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vs4hg" Jun 11 14:59:33.089330 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.089303 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vs4hg"] Jun 11 14:59:33.101856 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:33.101830 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a07253d_7012_4851_a956_67fe73f789d8.slice/crio-312258d30d97e4ed022b47a21e87d9395046e38786d9cee34836486e635727ac WatchSource:0}: Error finding container 312258d30d97e4ed022b47a21e87d9395046e38786d9cee34836486e635727ac: Status 404 returned error can't find the container with id 312258d30d97e4ed022b47a21e87d9395046e38786d9cee34836486e635727ac Jun 11 14:59:33.311701 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.311629 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9baf735-9863-4078-926c-975755339d98" containerID="6d5d62ca7ac6d1028b1d056138d040908f4d36517e7a568a8d83b3c0370ec20c" exitCode=0 Jun 11 14:59:33.311858 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.311699 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerDied","Data":"6d5d62ca7ac6d1028b1d056138d040908f4d36517e7a568a8d83b3c0370ec20c"} Jun 11 14:59:33.312832 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.312806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vs4hg" event={"ID":"1a07253d-7012-4851-a956-67fe73f789d8","Type":"ContainerStarted","Data":"312258d30d97e4ed022b47a21e87d9395046e38786d9cee34836486e635727ac"} Jun 11 14:59:33.344924 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.344902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:33.345015 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:33.344942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:33.345068 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:33.345048 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:33.345068 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:33.345064 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:33.345068 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:33.345065 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:33.345188 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:33.345113 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:34.345095984 +0000 UTC m=+36.666397086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:33.345188 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:33.345134 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:34.345123994 +0000 UTC m=+36.666425095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:34.144433 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.144247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 14:59:34.145008 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.144247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 14:59:34.145008 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.144313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 14:59:34.147472 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.147451 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:59:34.148934 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.148915 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:59:34.149054 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.148954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:59:34.149054 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.148986 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4p2b\"" Jun 11 14:59:34.149054 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.148999 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zdl6h\"" Jun 11 14:59:34.149054 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.148954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:59:34.219820 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.219780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:34.314789 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.314752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:34.318710 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.318684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" event={"ID":"a9baf735-9863-4078-926c-975755339d98","Type":"ContainerStarted","Data":"b6285e1312988d99fb23719989a2c660f5e16f7ea76659501a021c375f0e4b36"} Jun 11 14:59:34.342056 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.342015 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6qsl4" podStartSLOduration=7.8895992150000005 podStartE2EDuration="36.342002685s" totalImagesPullingTime="28.45240347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:34.341595729 +0000 UTC m=+36.662896852" watchObservedRunningTime="2026-06-11 14:59:34.342002685 +0000 UTC m=+36.663303808" Jun 11 14:59:34.351857 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.351811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:34.351857 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.351842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:34.352083 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:34.351931 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:34.352083 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:34.351951 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:34.352083 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:34.351969 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:34.352083 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:34.351975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:36.351964968 +0000 UTC m=+38.673266069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:34.352083 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:34.352013 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:36.352001434 +0000 UTC m=+38.673302535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:34.415077 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.415049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:34.517286 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.517251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:34.617700 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:34.617673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:36.324441 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:36.324415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vs4hg" event={"ID":"1a07253d-7012-4851-a956-67fe73f789d8","Type":"ContainerStarted","Data":"acca499cc63491c1e00373dea20365eceeb570f2733c1a894acabfa643626fe3"} Jun 11 14:59:36.339793 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:36.339745 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vs4hg" podStartSLOduration=1.8940239650000001 podStartE2EDuration="4.339707145s" totalImagesPullingTime="2.44568318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:36.339708376 +0000 UTC m=+38.661009499" watchObservedRunningTime="2026-06-11 14:59:36.339707145 +0000 UTC m=+38.661008269" Jun 11 14:59:36.370132 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:36.370109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:36.370259 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:36.370150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:36.370327 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:36.370267 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:36.370327 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:36.370284 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:36.370327 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:36.370290 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:36.370444 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:36.370336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:40.370322256 +0000 UTC m=+42.691623360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:36.370444 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:36.370353 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:40.370346087 +0000 UTC m=+42.691647188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:37.788444 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:37.788414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:37.845292 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:37.845260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:40.399699 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:40.399660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:40.399709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:40.399822 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:40.399830 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:40.399849 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:40.399874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:48.399860627 +0000 UTC m=+50.721161729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:40.400082 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:40.399896 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:48.399883025 +0000 UTC m=+50.721184125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:41.064064 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.064032 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-b7s4j"] Jun 11 14:59:41.095394 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.095369 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-b7s4j"] Jun 11 14:59:41.095532 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.095462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.098155 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.098129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 14:59:41.098292 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.098256 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:59:41.098405 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.098384 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 14:59:41.098466 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.098425 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wbqld\"" Jun 11 14:59:41.099808 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.099795 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:59:41.105378 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.105360 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 14:59:41.205350 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-service-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.205487 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d77a079-124b-4718-81f2-0774f58289d9-serving-cert\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.205487 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-trusted-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.205487 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-tmp\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.205487 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-snapshots\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.205636 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.205505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggj5\" (UniqueName: \"kubernetes.io/projected/0d77a079-124b-4718-81f2-0774f58289d9-kube-api-access-zggj5\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.211213 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.211185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:41.287419 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.287386 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:41.306473 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-tmp\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306573 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-snapshots\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306573 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggj5\" (UniqueName: \"kubernetes.io/projected/0d77a079-124b-4718-81f2-0774f58289d9-kube-api-access-zggj5\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306573 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-service-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306712 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d77a079-124b-4718-81f2-0774f58289d9-serving-cert\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306712 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-trusted-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.306897 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.306877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-tmp\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.307159 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.307134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-service-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.307201 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.307148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d77a079-124b-4718-81f2-0774f58289d9-snapshots\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.307400 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.307384 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d77a079-124b-4718-81f2-0774f58289d9-trusted-ca-bundle\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.310098 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.310079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d77a079-124b-4718-81f2-0774f58289d9-serving-cert\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.314462 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.314402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggj5\" (UniqueName: \"kubernetes.io/projected/0d77a079-124b-4718-81f2-0774f58289d9-kube-api-access-zggj5\") pod \"insights-operator-896549976-b7s4j\" (UID: \"0d77a079-124b-4718-81f2-0774f58289d9\") " pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.404844 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.404795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-b7s4j" Jun 11 14:59:41.551522 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:41.551493 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-b7s4j"] Jun 11 14:59:41.556331 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:41.556307 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d77a079_124b_4718_81f2_0774f58289d9.slice/crio-9107ab35b2373501b07c5e81fa191ef03805228b5337632b7f701c5dc952c5a9 WatchSource:0}: Error finding container 9107ab35b2373501b07c5e81fa191ef03805228b5337632b7f701c5dc952c5a9: Status 404 returned error can't find the container with id 9107ab35b2373501b07c5e81fa191ef03805228b5337632b7f701c5dc952c5a9 Jun 11 14:59:42.007088 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.007044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:42.083201 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.083164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:42.145217 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.145128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:42.342392 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.342319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-b7s4j" event={"ID":"0d77a079-124b-4718-81f2-0774f58289d9","Type":"ContainerStarted","Data":"9107ab35b2373501b07c5e81fa191ef03805228b5337632b7f701c5dc952c5a9"} Jun 11 14:59:42.765855 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.765823 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt"] Jun 11 14:59:42.786833 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.786810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt"] Jun 11 14:59:42.786995 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.786913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" Jun 11 14:59:42.790146 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.790123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4nxk7\"" Jun 11 14:59:42.921596 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:42.921561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwx8\" (UniqueName: \"kubernetes.io/projected/71f66eee-c434-459e-b4d9-b5053bfb6af5-kube-api-access-zvwx8\") pod \"network-check-source-dbd9cf844-n62dt\" (UID: \"71f66eee-c434-459e-b4d9-b5053bfb6af5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" Jun 11 14:59:43.022289 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:43.022197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwx8\" (UniqueName: \"kubernetes.io/projected/71f66eee-c434-459e-b4d9-b5053bfb6af5-kube-api-access-zvwx8\") pod \"network-check-source-dbd9cf844-n62dt\" (UID: \"71f66eee-c434-459e-b4d9-b5053bfb6af5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" Jun 11 14:59:43.032453 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:43.032426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwx8\" (UniqueName: \"kubernetes.io/projected/71f66eee-c434-459e-b4d9-b5053bfb6af5-kube-api-access-zvwx8\") pod \"network-check-source-dbd9cf844-n62dt\" (UID: \"71f66eee-c434-459e-b4d9-b5053bfb6af5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" Jun 11 14:59:43.096366 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:43.096325 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" Jun 11 14:59:43.356589 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:43.356538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:43.469551 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:43.469521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt"] Jun 11 14:59:43.472449 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:43.472422 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f66eee_c434_459e_b4d9_b5053bfb6af5.slice/crio-6c253251fbdc860d2b9650c28c816ae4a9c3b690f0b03924732e8bdaa4720d2b WatchSource:0}: Error finding container 6c253251fbdc860d2b9650c28c816ae4a9c3b690f0b03924732e8bdaa4720d2b: Status 404 returned error can't find the container with id 6c253251fbdc860d2b9650c28c816ae4a9c3b690f0b03924732e8bdaa4720d2b Jun 11 14:59:44.046789 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:44.046695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:44.112043 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:44.111987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:44.361740 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:44.361638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-b7s4j" event={"ID":"0d77a079-124b-4718-81f2-0774f58289d9","Type":"ContainerStarted","Data":"3de7445fadab202f1496d39953e3e7baa601e1f71375535b41243779daf35fda"} Jun 11 14:59:44.363156 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:44.363131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" event={"ID":"71f66eee-c434-459e-b4d9-b5053bfb6af5","Type":"ContainerStarted","Data":"6c253251fbdc860d2b9650c28c816ae4a9c3b690f0b03924732e8bdaa4720d2b"} Jun 11 14:59:44.383390 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:44.383330 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-b7s4j" podStartSLOduration=1.216666947 podStartE2EDuration="3.383317913s" totalImagesPullingTime="2.166650966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:44.383154316 +0000 UTC m=+46.704455440" watchObservedRunningTime="2026-06-11 14:59:44.383317913 +0000 UTC m=+46.704619034" Jun 11 14:59:46.046265 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:46.046189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:46.270107 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:46.270068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:46.393248 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:46.393166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:46.924238 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:46.924205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.041386 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.041338 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.240167 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.240133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.373593 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.373564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" event={"ID":"71f66eee-c434-459e-b4d9-b5053bfb6af5","Type":"ContainerStarted","Data":"bcf86288b9db858c5132a56672801754200c2ca3e8bc88b3cb2d1e1536f58c52"} Jun 11 14:59:47.389978 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.389936 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n62dt" podStartSLOduration=2.064148325 podStartE2EDuration="5.389921276s" totalImagesPullingTime="3.325772951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:47.388952072 +0000 UTC m=+49.710253211" watchObservedRunningTime="2026-06-11 14:59:47.389921276 +0000 UTC m=+49.711222429" Jun 11 14:59:47.453280 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.453246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.612054 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.611960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.684056 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.684028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.873029 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.872938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:47.978828 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:47.978795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:48.166272 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.166248 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4kw8_be344747-fa85-4ec3-bdbf-bbe96e6938ea/dns-node-resolver/0.log" Jun 11 14:59:48.465313 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.465236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 14:59:48.465313 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.465283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 14:59:48.465758 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.465386 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:59:48.465758 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.465403 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7458c6dc97-xwb54: secret "image-registry-tls" not found Jun 11 14:59:48.465758 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.465437 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:59:48.465758 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.465478 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls podName:843bbca3-33a3-4538-8b32-e59461cd7828 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:04.465459412 +0000 UTC m=+66.786760528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls") pod "image-registry-7458c6dc97-xwb54" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828") : secret "image-registry-tls" not found Jun 11 14:59:48.465758 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.465496 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls podName:1bf34254-ea68-4c23-9a41-e45238392b35 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:04.465487913 +0000 UTC m=+66.786789013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls") pod "dns-default-mdk6s" (UID: "1bf34254-ea68-4c23-9a41-e45238392b35") : secret "dns-default-metrics-tls" not found Jun 11 14:59:48.710549 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.710511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:48.808447 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.808370 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nj2td"] Jun 11 14:59:48.824022 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.823999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.830047 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.830007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:59:48.830047 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.830027 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p65kp\"" Jun 11 14:59:48.830248 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.830012 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:59:48.834672 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.832081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj2td"] Jun 11 14:59:48.869563 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.869532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/535c1751-925d-40ed-8b80-94542faee743-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.869563 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.869563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/535c1751-925d-40ed-8b80-94542faee743-data-volume\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.869816 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.869581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prk5j\" (UniqueName: \"kubernetes.io/projected/535c1751-925d-40ed-8b80-94542faee743-kube-api-access-prk5j\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.869816 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.869678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/535c1751-925d-40ed-8b80-94542faee743-crio-socket\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.869816 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.869756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.967773 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.967740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9pjv8_28a8b668-bbc6-49ca-b054-8a4f1b1b4a47/node-ca/0.log" Jun 11 14:59:48.971016 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.970993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/535c1751-925d-40ed-8b80-94542faee743-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971110 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/535c1751-925d-40ed-8b80-94542faee743-data-volume\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971110 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prk5j\" (UniqueName: \"kubernetes.io/projected/535c1751-925d-40ed-8b80-94542faee743-kube-api-access-prk5j\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971110 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/535c1751-925d-40ed-8b80-94542faee743-crio-socket\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971227 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971282 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.971268 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 14:59:48.971324 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/535c1751-925d-40ed-8b80-94542faee743-crio-socket\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971355 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:48.971336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls podName:535c1751-925d-40ed-8b80-94542faee743 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:49.471318416 +0000 UTC m=+51.792619519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj2td" (UID: "535c1751-925d-40ed-8b80-94542faee743") : secret "insights-runtime-extractor-tls" not found Jun 11 14:59:48.971420 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/535c1751-925d-40ed-8b80-94542faee743-data-volume\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.971582 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.971566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/535c1751-925d-40ed-8b80-94542faee743-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:48.988273 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:48.988250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prk5j\" (UniqueName: \"kubernetes.io/projected/535c1751-925d-40ed-8b80-94542faee743-kube-api-access-prk5j\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:49.217601 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.217567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:49.283452 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.283421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:49.476270 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.476209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:49.476579 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:49.476321 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 14:59:49.476579 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:49.476365 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls podName:535c1751-925d-40ed-8b80-94542faee743 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:50.476353567 +0000 UTC m=+52.797654667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj2td" (UID: "535c1751-925d-40ed-8b80-94542faee743") : secret "insights-runtime-extractor-tls" not found Jun 11 14:59:49.482194 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.482167 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-n9nmc"] Jun 11 14:59:49.503534 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.503513 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-n9nmc"] Jun 11 14:59:49.503620 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.503594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.506593 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.506569 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 14:59:49.506755 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.506734 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 14:59:49.506825 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.506722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pkx74\"" Jun 11 14:59:49.506825 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.506743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 14:59:49.507030 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.507018 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 14:59:49.516680 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.516661 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:49.577373 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.577344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-key\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.577467 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.577452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqzh\" (UniqueName: \"kubernetes.io/projected/77b6e353-8abe-4d19-b83c-e5d9545a377d-kube-api-access-zzqzh\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.577502 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.577474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-cabundle\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.678565 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.678538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-key\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.678693 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.678647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqzh\" (UniqueName: \"kubernetes.io/projected/77b6e353-8abe-4d19-b83c-e5d9545a377d-kube-api-access-zzqzh\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.678693 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.678672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-cabundle\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.679258 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.679237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-cabundle\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.680986 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.680971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77b6e353-8abe-4d19-b83c-e5d9545a377d-signing-key\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.691132 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.691115 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqzh\" (UniqueName: \"kubernetes.io/projected/77b6e353-8abe-4d19-b83c-e5d9545a377d-kube-api-access-zzqzh\") pod \"service-ca-7d74d578b8-n9nmc\" (UID: \"77b6e353-8abe-4d19-b83c-e5d9545a377d\") " pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.812595 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.812519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" Jun 11 14:59:49.948028 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.947989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-n9nmc"] Jun 11 14:59:49.951652 ip-10-0-128-43 kubenswrapper[2581]: W0611 14:59:49.951622 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b6e353_8abe_4d19_b83c_e5d9545a377d.slice/crio-5394f32360252db6a8b9a60d6aacd26ef9b42eeeb26ed09de6407dbfccc31590 WatchSource:0}: Error finding container 5394f32360252db6a8b9a60d6aacd26ef9b42eeeb26ed09de6407dbfccc31590: Status 404 returned error can't find the container with id 5394f32360252db6a8b9a60d6aacd26ef9b42eeeb26ed09de6407dbfccc31590 Jun 11 14:59:49.963345 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:49.963322 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vs4hg_1a07253d-7012-4851-a956-67fe73f789d8/serve-healthcheck-canary/0.log" Jun 11 14:59:50.380911 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:50.380879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" event={"ID":"77b6e353-8abe-4d19-b83c-e5d9545a377d","Type":"ContainerStarted","Data":"5394f32360252db6a8b9a60d6aacd26ef9b42eeeb26ed09de6407dbfccc31590"} Jun 11 14:59:50.485589 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:50.485559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:50.486040 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:50.485679 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 14:59:50.486040 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:50.485750 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls podName:535c1751-925d-40ed-8b80-94542faee743 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:52.485713027 +0000 UTC m=+54.807014128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj2td" (UID: "535c1751-925d-40ed-8b80-94542faee743") : secret "insights-runtime-extractor-tls" not found Jun 11 14:59:50.816169 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:50.816136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:52.388553 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:52.388521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" event={"ID":"77b6e353-8abe-4d19-b83c-e5d9545a377d","Type":"ContainerStarted","Data":"1019920b7a64a06832e1db5bcb33f0c55c4bcf7a09f08df7ef8e601e5f39a4f0"} Jun 11 14:59:52.414452 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:52.414400 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-n9nmc" podStartSLOduration=1.164101586 podStartE2EDuration="3.414384586s" totalImagesPullingTime="2.250283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:52.413998918 +0000 UTC m=+54.735300040" watchObservedRunningTime="2026-06-11 14:59:52.414384586 +0000 UTC m=+54.735685708" Jun 11 14:59:52.503490 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:52.503418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:52.507298 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:52.503920 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 14:59:52.507298 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:52.504051 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls podName:535c1751-925d-40ed-8b80-94542faee743 nodeName:}" failed. No retries permitted until 2026-06-11 14:59:56.504033791 +0000 UTC m=+58.825334909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj2td" (UID: "535c1751-925d-40ed-8b80-94542faee743") : secret "insights-runtime-extractor-tls" not found Jun 11 14:59:53.524492 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:53.524450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:53.645696 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:53.645654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:53.726926 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:53.726891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:53.828383 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:53.828307 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:53.942212 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:53.942189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:54.599821 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:54.599788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:54.673707 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:54.673680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:55.233112 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:55.233085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:55.429145 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:55.429120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:55.846672 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:55.846642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:56.049663 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:56.049631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:56.532243 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:56.532213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 14:59:56.532389 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:56.532343 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 14:59:56.532453 ip-10-0-128-43 kubenswrapper[2581]: E0611 14:59:56.532409 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls podName:535c1751-925d-40ed-8b80-94542faee743 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:04.532390134 +0000 UTC m=+66.853691252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj2td" (UID: "535c1751-925d-40ed-8b80-94542faee743") : secret "insights-runtime-extractor-tls" not found Jun 11 14:59:56.634013 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:56.633987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:57.028825 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:57.028802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:57.233459 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:57.233434 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:57.438298 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:57.438238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:57.540998 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:57.540960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:57.641169 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:57.641133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:58.250769 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:58.250742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:58.306406 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:58.306384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ckdt2" Jun 11 14:59:58.335772 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:58.335746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:58.429886 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:58.429855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:59.028225 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:59.028180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:59.460509 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:59.460480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:59.625229 ip-10-0-128-43 kubenswrapper[2581]: I0611 14:59:59.625196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:00.031358 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:00.031324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:00.630169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:00.630134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:00.705043 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:00.705013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:01.227536 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:01.227515 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:01.427153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:01.427117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:01.632939 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:01.632870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:02.037938 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:02.037908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:02.424067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:02.424038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:02.821095 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:02.821021 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:02.937908 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:02.937877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:03.418373 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.418343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:03.831157 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.831082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:03.883736 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.883694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 15:00:03.887024 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.887007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:00:03.896768 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.896739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91c6b185-0b9d-4ca5-9abb-81d8351eec75-original-pull-secret\") pod \"global-pull-secret-syncer-6f84f\" (UID: \"91c6b185-0b9d-4ca5-9abb-81d8351eec75\") " pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 15:00:03.984676 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.984645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 15:00:03.984817 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.984689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 15:00:03.987327 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.987301 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txzcn\" (UniqueName: \"kubernetes.io/projected/5e95d162-47e4-4741-ab66-fd3fcbf4302d-kube-api-access-txzcn\") pod \"network-check-target-kdpjp\" (UID: \"5e95d162-47e4-4741-ab66-fd3fcbf4302d\") " pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 15:00:03.987741 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.987713 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:00:03.997237 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:03.997214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f58024c-62a7-451e-84c4-ab34eb1a5e97-metrics-certs\") pod \"network-metrics-daemon-6tmn7\" (UID: \"2f58024c-62a7-451e-84c4-ab34eb1a5e97\") " pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 15:00:04.017866 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.017837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:04.155796 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.155775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6f84f" Jun 11 15:00:04.165374 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.165348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4p2b\"" Jun 11 15:00:04.170087 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.170069 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zdl6h\"" Jun 11 15:00:04.173613 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.173593 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tmn7" Jun 11 15:00:04.177861 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.177842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 15:00:04.226163 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.226092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:04.296941 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.296915 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6f84f"] Jun 11 15:00:04.302797 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:04.302773 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c6b185_0b9d_4ca5_9abb_81d8351eec75.slice/crio-6d23c33c2fb162449094311e22faa72aceb801f8d3d0b3a6ca04b94cb6ce485c WatchSource:0}: Error finding container 6d23c33c2fb162449094311e22faa72aceb801f8d3d0b3a6ca04b94cb6ce485c: Status 404 returned error can't find the container with id 6d23c33c2fb162449094311e22faa72aceb801f8d3d0b3a6ca04b94cb6ce485c Jun 11 15:00:04.311830 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.311809 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tmn7"] Jun 11 15:00:04.314497 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:04.314473 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f58024c_62a7_451e_84c4_ab34eb1a5e97.slice/crio-65e63de9aad1fb71a95a659286574da7d6dfb30c26850fb64661910ede9884e6 WatchSource:0}: Error finding container 65e63de9aad1fb71a95a659286574da7d6dfb30c26850fb64661910ede9884e6: Status 404 returned error can't find the container with id 65e63de9aad1fb71a95a659286574da7d6dfb30c26850fb64661910ede9884e6 Jun 11 15:00:04.329811 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.329793 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kdpjp"] Jun 11 15:00:04.332223 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:04.332198 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e95d162_47e4_4741_ab66_fd3fcbf4302d.slice/crio-cfb0e0aae659f28031c27270b9399f7f2dc554b1fe05e0caf6a45f78062621de WatchSource:0}: Error finding container cfb0e0aae659f28031c27270b9399f7f2dc554b1fe05e0caf6a45f78062621de: Status 404 returned error can't find the container with id cfb0e0aae659f28031c27270b9399f7f2dc554b1fe05e0caf6a45f78062621de Jun 11 15:00:04.425421 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.425330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tmn7" event={"ID":"2f58024c-62a7-451e-84c4-ab34eb1a5e97","Type":"ContainerStarted","Data":"65e63de9aad1fb71a95a659286574da7d6dfb30c26850fb64661910ede9884e6"} Jun 11 15:00:04.426461 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.426432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6f84f" event={"ID":"91c6b185-0b9d-4ca5-9abb-81d8351eec75","Type":"ContainerStarted","Data":"6d23c33c2fb162449094311e22faa72aceb801f8d3d0b3a6ca04b94cb6ce485c"} Jun 11 15:00:04.427757 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.427737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdpjp" event={"ID":"5e95d162-47e4-4741-ab66-fd3fcbf4302d","Type":"ContainerStarted","Data":"033d646fc82f0d84c7c1d731ca6cf7824a799f9e1dc3bee07653d026a45cd983"} Jun 11 15:00:04.427833 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.427769 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kdpjp" event={"ID":"5e95d162-47e4-4741-ab66-fd3fcbf4302d","Type":"ContainerStarted","Data":"cfb0e0aae659f28031c27270b9399f7f2dc554b1fe05e0caf6a45f78062621de"} Jun 11 15:00:04.427964 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.427950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 15:00:04.444306 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.444267 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kdpjp" podStartSLOduration=66.444254495 podStartE2EDuration="1m6.444254495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:04.444010855 +0000 UTC m=+66.765312039" watchObservedRunningTime="2026-06-11 15:00:04.444254495 +0000 UTC m=+66.765555646" Jun 11 15:00:04.488378 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.488352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:04.488471 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.488388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 15:00:04.490838 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.490821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bf34254-ea68-4c23-9a41-e45238392b35-metrics-tls\") pod \"dns-default-mdk6s\" (UID: \"1bf34254-ea68-4c23-9a41-e45238392b35\") " pod="openshift-dns/dns-default-mdk6s" Jun 11 15:00:04.490950 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.490934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"image-registry-7458c6dc97-xwb54\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:04.589338 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.589313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 15:00:04.591588 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.591569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/535c1751-925d-40ed-8b80-94542faee743-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj2td\" (UID: \"535c1751-925d-40ed-8b80-94542faee743\") " pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 15:00:04.697192 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.697140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8h69h\"" Jun 11 15:00:04.704812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.704798 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:04.715301 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.715282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmhvb\"" Jun 11 15:00:04.722992 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.722973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mdk6s" Jun 11 15:00:04.740458 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.740420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p65kp\"" Jun 11 15:00:04.748107 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.748073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj2td" Jun 11 15:00:04.850944 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.850915 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 15:00:04.874997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.874972 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mdk6s"] Jun 11 15:00:04.907717 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:04.904644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj2td"] Jun 11 15:00:04.910911 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:04.910878 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535c1751_925d_40ed_8b80_94542faee743.slice/crio-b4db6f769444c28a1b12b7a2da5f19c79df96ffc6705d076f8c276ddf2508807 WatchSource:0}: Error finding container b4db6f769444c28a1b12b7a2da5f19c79df96ffc6705d076f8c276ddf2508807: Status 404 returned error can't find the container with id b4db6f769444c28a1b12b7a2da5f19c79df96ffc6705d076f8c276ddf2508807 Jun 11 15:00:05.433263 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.433236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj2td" event={"ID":"535c1751-925d-40ed-8b80-94542faee743","Type":"ContainerStarted","Data":"8b26dc710c16c02b9170f9cfeb87ae1b43dbf640a7f491261c98d60c50001347"} Jun 11 15:00:05.433327 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.433303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj2td" event={"ID":"535c1751-925d-40ed-8b80-94542faee743","Type":"ContainerStarted","Data":"b4db6f769444c28a1b12b7a2da5f19c79df96ffc6705d076f8c276ddf2508807"} Jun 11 15:00:05.442501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.442434 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdk6s" event={"ID":"1bf34254-ea68-4c23-9a41-e45238392b35","Type":"ContainerStarted","Data":"03cb3eafb6de48488d854299c1f30cbb4b7c224f3107fdfaeb3cc95efd3c3ccc"} Jun 11 15:00:05.445673 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.445642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" event={"ID":"843bbca3-33a3-4538-8b32-e59461cd7828","Type":"ContainerStarted","Data":"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376"} Jun 11 15:00:05.445841 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.445697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" event={"ID":"843bbca3-33a3-4538-8b32-e59461cd7828","Type":"ContainerStarted","Data":"c6d9559ac2b99d20deff2b95d9eaa8edf3b22e904b4a764e7c7f81f217d35b82"} Jun 11 15:00:05.473757 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:05.473676 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" podStartSLOduration=67.473661204 podStartE2EDuration="1m7.473661204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:05.471607192 +0000 UTC m=+67.792908314" watchObservedRunningTime="2026-06-11 15:00:05.473661204 +0000 UTC m=+67.794962325" Jun 11 15:00:06.451924 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:06.451889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj2td" event={"ID":"535c1751-925d-40ed-8b80-94542faee743","Type":"ContainerStarted","Data":"18e082504824562e1ad16824cb2f4bb5b670c746b39cc12079ee2f5f08443743"} Jun 11 15:00:06.453969 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:06.453940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tmn7" event={"ID":"2f58024c-62a7-451e-84c4-ab34eb1a5e97","Type":"ContainerStarted","Data":"d53d28b3cdcc9dac714f81ad9a1fc3c2d4635974e2fc59e06f9142bf6d07e6b2"} Jun 11 15:00:06.454086 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:06.453994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tmn7" event={"ID":"2f58024c-62a7-451e-84c4-ab34eb1a5e97","Type":"ContainerStarted","Data":"d2242632d96ade80cc79e4d7c12d0ff6c9a03d68c4b222824ccb97bda701a272"} Jun 11 15:00:06.454369 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:06.454348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:06.474383 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:06.474321 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tmn7" podStartSLOduration=67.372871533 podStartE2EDuration="1m8.474303206s" totalImagesPullingTime="1.101431673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:06.473257112 +0000 UTC m=+68.794558235" watchObservedRunningTime="2026-06-11 15:00:06.474303206 +0000 UTC m=+68.795604327" Jun 11 15:00:08.464405 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.464366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj2td" event={"ID":"535c1751-925d-40ed-8b80-94542faee743","Type":"ContainerStarted","Data":"5948e1ccd9f46f3e6a6e96e6db32d43432637e98225e99dd027858e7cbf85686"} Jun 11 15:00:08.466564 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.466531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdk6s" event={"ID":"1bf34254-ea68-4c23-9a41-e45238392b35","Type":"ContainerStarted","Data":"ba222efd3e46002ac245abbbfcd69efa4cb02b91488bfeb5478e4e17f3f59c57"} Jun 11 15:00:08.466682 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.466583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mdk6s" event={"ID":"1bf34254-ea68-4c23-9a41-e45238392b35","Type":"ContainerStarted","Data":"6ee9119b2fff3c3c4c7b667dd8fbb83e57d83d0e24a8f0ecb96222bdc17c7abb"} Jun 11 15:00:08.466682 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.466616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mdk6s" Jun 11 15:00:08.488159 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.488110 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nj2td" podStartSLOduration=17.722761436 podStartE2EDuration="20.488095648s" totalImagesPullingTime="2.765334212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:59:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:08.487351791 +0000 UTC m=+70.808652915" watchObservedRunningTime="2026-06-11 15:00:08.488095648 +0000 UTC m=+70.809396764" Jun 11 15:00:08.505552 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:08.505510 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mdk6s" podStartSLOduration=33.566149203 podStartE2EDuration="36.50549919s" totalImagesPullingTime="2.939349987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:08.504349917 +0000 UTC m=+70.825651039" watchObservedRunningTime="2026-06-11 15:00:08.50549919 +0000 UTC m=+70.826800312" Jun 11 15:00:10.218333 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.218302 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb"] Jun 11 15:00:10.221900 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.221880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.224893 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.224875 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 15:00:10.225326 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.225309 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 15:00:10.225326 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.225327 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 15:00:10.225473 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.225309 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 15:00:10.237285 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.237264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb"] Jun 11 15:00:10.329523 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.329495 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw"] Jun 11 15:00:10.332403 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.332367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8418cfb4-0413-4e5b-846f-b122f0e863cc-tmp\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.332512 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.332431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njn9p\" (UniqueName: \"kubernetes.io/projected/8418cfb4-0413-4e5b-846f-b122f0e863cc-kube-api-access-njn9p\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.332512 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.332481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8418cfb4-0413-4e5b-846f-b122f0e863cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.333762 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.333747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.336920 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.336897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 15:00:10.337016 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.336943 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 15:00:10.337064 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.337018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-skr4l\"" Jun 11 15:00:10.344489 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.344469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw"] Jun 11 15:00:10.385842 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.385816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:10.433247 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8418cfb4-0413-4e5b-846f-b122f0e863cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.433354 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8418cfb4-0413-4e5b-846f-b122f0e863cc-tmp\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.433354 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.433354 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.433455 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njn9p\" (UniqueName: \"kubernetes.io/projected/8418cfb4-0413-4e5b-846f-b122f0e863cc-kube-api-access-njn9p\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.433665 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.433647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8418cfb4-0413-4e5b-846f-b122f0e863cc-tmp\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.435849 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.435834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8418cfb4-0413-4e5b-846f-b122f0e863cc-klusterlet-config\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.442159 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.442139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njn9p\" (UniqueName: \"kubernetes.io/projected/8418cfb4-0413-4e5b-846f-b122f0e863cc-kube-api-access-njn9p\") pod \"klusterlet-addon-workmgr-8dbcd7b5b-thnhb\" (UID: \"8418cfb4-0413-4e5b-846f-b122f0e863cc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.474909 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.474831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6f84f" event={"ID":"91c6b185-0b9d-4ca5-9abb-81d8351eec75","Type":"ContainerStarted","Data":"065e3d4405c4a2cd2cb0d908bbd041c2dd38809ccb022178896e5c9a5d9446fe"} Jun 11 15:00:10.488606 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.488581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:10.500086 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.500042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6f84f" podStartSLOduration=67.325158862 podStartE2EDuration="1m12.500026147s" totalImagesPullingTime="5.174867285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:10.498869429 +0000 UTC m=+72.820170551" watchObservedRunningTime="2026-06-11 15:00:10.500026147 +0000 UTC m=+72.821327271" Jun 11 15:00:10.530607 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.530582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:10.534073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.533704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.534073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.533749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.534302 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.534281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.536187 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.536168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f5c5bf3b-9740-40be-aae1-3f5a589d60f5-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m64gw\" (UID: \"f5c5bf3b-9740-40be-aae1-3f5a589d60f5\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.593639 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.593604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:10.642203 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.642174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" Jun 11 15:00:10.662452 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.662424 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb"] Jun 11 15:00:10.665361 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:10.665313 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8418cfb4_0413_4e5b_846f_b122f0e863cc.slice/crio-2711670db4090b8d413ee94e4934390821ab2cf452f8f9f9c81ed8a143541606 WatchSource:0}: Error finding container 2711670db4090b8d413ee94e4934390821ab2cf452f8f9f9c81ed8a143541606: Status 404 returned error can't find the container with id 2711670db4090b8d413ee94e4934390821ab2cf452f8f9f9c81ed8a143541606 Jun 11 15:00:10.722026 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.721963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:10.772087 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.772065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw"] Jun 11 15:00:10.774223 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:10.774195 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c5bf3b_9740_40be_aae1_3f5a589d60f5.slice/crio-1134eb1bebb0adbd39297c7a0f6dc8eeebe2b0c06aaefe7702ecb50fd45b006b WatchSource:0}: Error finding container 1134eb1bebb0adbd39297c7a0f6dc8eeebe2b0c06aaefe7702ecb50fd45b006b: Status 404 returned error can't find the container with id 1134eb1bebb0adbd39297c7a0f6dc8eeebe2b0c06aaefe7702ecb50fd45b006b Jun 11 15:00:10.823398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:10.823358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:11.479968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:11.479931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" event={"ID":"f5c5bf3b-9740-40be-aae1-3f5a589d60f5","Type":"ContainerStarted","Data":"1134eb1bebb0adbd39297c7a0f6dc8eeebe2b0c06aaefe7702ecb50fd45b006b"} Jun 11 15:00:11.481176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:11.481150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" event={"ID":"8418cfb4-0413-4e5b-846f-b122f0e863cc","Type":"ContainerStarted","Data":"2711670db4090b8d413ee94e4934390821ab2cf452f8f9f9c81ed8a143541606"} Jun 11 15:00:12.100966 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:12.100885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:12.287921 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:12.287813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:12.352401 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:12.352372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:12.486178 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:12.486143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" event={"ID":"f5c5bf3b-9740-40be-aae1-3f5a589d60f5","Type":"ContainerStarted","Data":"f42896837c76e37961b32038a747b87b0f5b6f3087d73d8d6102c438d3d15fb4"} Jun 11 15:00:12.503171 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:12.503120 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m64gw" podStartSLOduration=1.32482533 podStartE2EDuration="2.503101663s" totalImagesPullingTime="1.178276333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:12.501976511 +0000 UTC m=+74.823277634" watchObservedRunningTime="2026-06-11 15:00:12.503101663 +0000 UTC m=+74.824402784" Jun 11 15:00:13.294879 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:13.294838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:13.687075 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:13.687024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:13.760176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:13.760146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:17.371985 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.371956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:17.468091 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.468062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:17.530674 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.530652 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v"] Jun 11 15:00:17.535748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.535733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:17.538946 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.538924 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dlpsv\"" Jun 11 15:00:17.539504 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.539489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 15:00:17.547981 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.547959 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v"] Jun 11 15:00:17.564657 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.564624 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:17.583419 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.583397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f77661ad-c73c-4c07-8c2d-f78b51e5bdc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p5m2v\" (UID: \"f77661ad-c73c-4c07-8c2d-f78b51e5bdc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:17.683716 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.683694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f77661ad-c73c-4c07-8c2d-f78b51e5bdc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p5m2v\" (UID: \"f77661ad-c73c-4c07-8c2d-f78b51e5bdc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:17.684391 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.684370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:17.686156 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.686135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f77661ad-c73c-4c07-8c2d-f78b51e5bdc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p5m2v\" (UID: \"f77661ad-c73c-4c07-8c2d-f78b51e5bdc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:17.844446 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.844418 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:17.971346 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:17.971287 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v"] Jun 11 15:00:17.973650 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:17.973618 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77661ad_c73c_4c07_8c2d_f78b51e5bdc6.slice/crio-6d9be4a362e967ab2ba307af38a8a62afcc68d2af989506836eb5c46a48ce705 WatchSource:0}: Error finding container 6d9be4a362e967ab2ba307af38a8a62afcc68d2af989506836eb5c46a48ce705: Status 404 returned error can't find the container with id 6d9be4a362e967ab2ba307af38a8a62afcc68d2af989506836eb5c46a48ce705 Jun 11 15:00:18.472173 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:18.472147 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mdk6s" Jun 11 15:00:18.507615 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:18.507584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" event={"ID":"f77661ad-c73c-4c07-8c2d-f78b51e5bdc6","Type":"ContainerStarted","Data":"6d9be4a362e967ab2ba307af38a8a62afcc68d2af989506836eb5c46a48ce705"} Jun 11 15:00:19.218903 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.218877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:19.314204 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.314177 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:19.512560 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.512492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" event={"ID":"f77661ad-c73c-4c07-8c2d-f78b51e5bdc6","Type":"ContainerStarted","Data":"b9eb43de20dc68929af1accd1cf801d23f0cee5e528d1b25d717c3001b4337cb"} Jun 11 15:00:19.512875 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.512716 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:19.517065 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.517042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" Jun 11 15:00:19.532370 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:19.532328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p5m2v" podStartSLOduration=1.3187137469999999 podStartE2EDuration="2.532314724s" totalImagesPullingTime="1.213600977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:19.53205486 +0000 UTC m=+81.853355984" watchObservedRunningTime="2026-06-11 15:00:19.532314724 +0000 UTC m=+81.853615846" Jun 11 15:00:20.335243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.335204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:20.578489 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.578464 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:20.694987 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.694953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:20.696298 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.696276 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-llp5f"] Jun 11 15:00:20.702167 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.702151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.707717 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.707699 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 15:00:20.709469 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.709450 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:00:20.709549 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.709451 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:00:20.709549 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.709506 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5wfzq\"" Jun 11 15:00:20.709664 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.709626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:00:20.709865 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.709850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 15:00:20.728754 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.728709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-llp5f"] Jun 11 15:00:20.794992 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.794967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:20.802928 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.802904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.803008 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.802952 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97afd2eb-7268-4dc1-9878-d9f97d083454-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.803046 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.803002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.803046 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.803031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7r64\" (UniqueName: \"kubernetes.io/projected/97afd2eb-7268-4dc1-9878-d9f97d083454-kube-api-access-p7r64\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.903765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.903740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.903850 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.903770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7r64\" (UniqueName: \"kubernetes.io/projected/97afd2eb-7268-4dc1-9878-d9f97d083454-kube-api-access-p7r64\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.903850 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.903799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.903850 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.903832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97afd2eb-7268-4dc1-9878-d9f97d083454-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.904471 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.904450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97afd2eb-7268-4dc1-9878-d9f97d083454-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.906248 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.906223 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.906365 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.906344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/97afd2eb-7268-4dc1-9878-d9f97d083454-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:20.916658 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:20.916636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7r64\" (UniqueName: \"kubernetes.io/projected/97afd2eb-7268-4dc1-9878-d9f97d083454-kube-api-access-p7r64\") pod \"prometheus-operator-7f7d445d84-llp5f\" (UID: \"97afd2eb-7268-4dc1-9878-d9f97d083454\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:21.011825 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:21.011740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" Jun 11 15:00:21.175226 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:21.175198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-llp5f"] Jun 11 15:00:21.177378 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:21.177354 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97afd2eb_7268_4dc1_9878_d9f97d083454.slice/crio-facf407ad5171cee2a4e988b62c4cbf055da1d14afabd8be42af37105afeddc5 WatchSource:0}: Error finding container facf407ad5171cee2a4e988b62c4cbf055da1d14afabd8be42af37105afeddc5: Status 404 returned error can't find the container with id facf407ad5171cee2a4e988b62c4cbf055da1d14afabd8be42af37105afeddc5 Jun 11 15:00:21.520501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:21.520475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" event={"ID":"97afd2eb-7268-4dc1-9878-d9f97d083454","Type":"ContainerStarted","Data":"facf407ad5171cee2a4e988b62c4cbf055da1d14afabd8be42af37105afeddc5"} Jun 11 15:00:22.632282 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:22.632247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:22.703966 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:22.703919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:22.794464 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:22.794378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:23.529468 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:23.529436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" event={"ID":"97afd2eb-7268-4dc1-9878-d9f97d083454","Type":"ContainerStarted","Data":"bd15171e37e940da5e45f20dc66a763b86180a29bc692e5e4c40dbe16a3129f9"} Jun 11 15:00:23.529624 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:23.529485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" event={"ID":"97afd2eb-7268-4dc1-9878-d9f97d083454","Type":"ContainerStarted","Data":"34e27bd4a08004092a5ab63b046f49e17990d82d576e8b09e9645c654e13a0d4"} Jun 11 15:00:23.556355 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:23.556310 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-llp5f" podStartSLOduration=2.255758738 podStartE2EDuration="3.556295077s" totalImagesPullingTime="1.300536339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:23.556092095 +0000 UTC m=+85.877393220" watchObservedRunningTime="2026-06-11 15:00:23.556295077 +0000 UTC m=+85.877596199" Jun 11 15:00:24.710769 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:24.710737 2581 patch_prober.go:28] interesting pod/image-registry-7458c6dc97-xwb54 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:00:24.711129 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:24.710789 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:00:24.869644 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:24.869604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:25.089224 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.089143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:25.236474 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.235662 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gtb2m"] Jun 11 15:00:25.239201 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.239182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.246578 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.246560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:00:25.249533 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.249515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p9wlr\"" Jun 11 15:00:25.251407 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.251385 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:00:25.251509 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.251433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:00:25.254504 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.254481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:25.332638 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-tls\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-sys\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-metrics-client-ca\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96kl2\" (UniqueName: \"kubernetes.io/projected/b57db7c3-32b2-48ef-91b1-4be39f48e179-kube-api-access-96kl2\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-root\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.332788 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-textfile\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.333091 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-wtmp\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.333091 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.332844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434011 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.433985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-metrics-client-ca\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96kl2\" (UniqueName: \"kubernetes.io/projected/b57db7c3-32b2-48ef-91b1-4be39f48e179-kube-api-access-96kl2\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-root\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-textfile\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-wtmp\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-root\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434525 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434228 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-wtmp\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434525 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434525 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-tls\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434525 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434651 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-sys\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434651 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b57db7c3-32b2-48ef-91b1-4be39f48e179-sys\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.434779 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.434759 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-textfile\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.435053 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.435007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-metrics-client-ca\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.435053 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.435019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.435755 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.435708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:25.437686 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.437666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.437792 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.437770 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b57db7c3-32b2-48ef-91b1-4be39f48e179-node-exporter-tls\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.455955 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.455934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96kl2\" (UniqueName: \"kubernetes.io/projected/b57db7c3-32b2-48ef-91b1-4be39f48e179-kube-api-access-96kl2\") pod \"node-exporter-gtb2m\" (UID: \"b57db7c3-32b2-48ef-91b1-4be39f48e179\") " pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.533950 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.533917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:25.550417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.550396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtb2m" Jun 11 15:00:25.561414 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:25.561383 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57db7c3_32b2_48ef_91b1_4be39f48e179.slice/crio-e54b364adf819fc613644d983fff4c81d2de4729f248f85010396cd07aebaf27 WatchSource:0}: Error finding container e54b364adf819fc613644d983fff4c81d2de4729f248f85010396cd07aebaf27: Status 404 returned error can't find the container with id e54b364adf819fc613644d983fff4c81d2de4729f248f85010396cd07aebaf27 Jun 11 15:00:25.713393 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:25.713291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:26.088119 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.088039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:26.238526 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.238495 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:00:26.247533 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.247506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.251139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t2cj7\"" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.251337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.251764 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.251940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.252109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:00:26.252897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.252257 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:00:26.253831 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.253812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:00:26.254175 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.254159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:00:26.254395 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.254373 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:00:26.254560 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.254438 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:00:26.255157 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.255138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:26.264686 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.264637 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:00:26.342177 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342177 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342177 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342409 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342468 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342519 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342626 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342712 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jg27\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342712 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342712 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342867 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.342867 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.342799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.441762 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.441640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:26.443607 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443713 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443713 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443713 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443713 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443955 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.443955 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444061 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.443983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444061 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444061 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jg27\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444221 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444221 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.444221 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.445209 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.444823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.445524 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.445496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.445852 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.445828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.450085 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.447821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.450609 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.450572 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451128 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451106 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451711 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451711 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451711 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451606 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451915 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.451915 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.451811 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.454069 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.454042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.454332 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.454313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jg27\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27\") pod \"alertmanager-main-0\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.541075 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.541045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtb2m" event={"ID":"b57db7c3-32b2-48ef-91b1-4be39f48e179","Type":"ContainerStarted","Data":"7c44de0d42c43158856100494aad360a9d5075211b4867ff147b4732b0b410a4"} Jun 11 15:00:26.541217 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.541111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtb2m" event={"ID":"b57db7c3-32b2-48ef-91b1-4be39f48e179","Type":"ContainerStarted","Data":"e54b364adf819fc613644d983fff4c81d2de4729f248f85010396cd07aebaf27"} Jun 11 15:00:26.563449 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.563426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:00:26.582403 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.582377 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:26.722117 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:26.722093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:00:26.724110 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:26.724083 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0f63e1_1385_449a_b6ed_c220b084f0a9.slice/crio-fd6fab9e76ff6f9f0194d06537351537d702e743712f69bf8c18590aaa079ca7 WatchSource:0}: Error finding container fd6fab9e76ff6f9f0194d06537351537d702e743712f69bf8c18590aaa079ca7: Status 404 returned error can't find the container with id fd6fab9e76ff6f9f0194d06537351537d702e743712f69bf8c18590aaa079ca7 Jun 11 15:00:27.464335 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.464307 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:27.547760 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.547534 2581 generic.go:356] "Generic (PLEG): container finished" podID="b57db7c3-32b2-48ef-91b1-4be39f48e179" containerID="7c44de0d42c43158856100494aad360a9d5075211b4867ff147b4732b0b410a4" exitCode=0 Jun 11 15:00:27.547760 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.547616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtb2m" event={"ID":"b57db7c3-32b2-48ef-91b1-4be39f48e179","Type":"ContainerDied","Data":"7c44de0d42c43158856100494aad360a9d5075211b4867ff147b4732b0b410a4"} Jun 11 15:00:27.549109 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.549084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"fd6fab9e76ff6f9f0194d06537351537d702e743712f69bf8c18590aaa079ca7"} Jun 11 15:00:27.624231 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.624194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:27.730494 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.730406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:27.928488 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:27.928457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:28.037293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.037216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:28.213481 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.213431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:28.337522 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.337441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:28.555011 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.554982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtb2m" event={"ID":"b57db7c3-32b2-48ef-91b1-4be39f48e179","Type":"ContainerStarted","Data":"6abf4b713c6b62559d255a428787d625172f95770050b62fce0d392eb6183441"} Jun 11 15:00:28.555244 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.555039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtb2m" event={"ID":"b57db7c3-32b2-48ef-91b1-4be39f48e179","Type":"ContainerStarted","Data":"84d4afbc327e2446cac9d2596b2406945ed3925b0d04c96e7cc75d9fd332b5a0"} Jun 11 15:00:28.556692 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.556665 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc" exitCode=0 Jun 11 15:00:28.556818 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.556710 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc"} Jun 11 15:00:28.585220 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.585174 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gtb2m" podStartSLOduration=2.6408079620000002 podStartE2EDuration="3.585156606s" totalImagesPullingTime="867.579576ms" totalInitContainerRuntime="76.769068ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:28.584947319 +0000 UTC m=+90.906248441" watchObservedRunningTime="2026-06-11 15:00:28.585156606 +0000 UTC m=+90.906457731" Jun 11 15:00:28.598245 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.598185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:28.760747 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:28.760688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:29.845599 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.845568 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4"] Jun 11 15:00:29.850098 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.850059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:29.851236 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.851207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:29.853621 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.853232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 15:00:29.853621 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.853486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mdnfh\"" Jun 11 15:00:29.857835 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.857812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4"] Jun 11 15:00:29.975206 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.975170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:29.975403 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:29.975304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7n7\" (UniqueName: \"kubernetes.io/projected/1735a346-4506-47ef-b75d-4566d6547894-kube-api-access-sb7n7\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.075856 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.075821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7n7\" (UniqueName: \"kubernetes.io/projected/1735a346-4506-47ef-b75d-4566d6547894-kube-api-access-sb7n7\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.076013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.075872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.076089 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:00:30.076030 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 15:00:30.076141 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:00:30.076128 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert podName:1735a346-4506-47ef-b75d-4566d6547894 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:30.576084981 +0000 UTC m=+92.897386084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-5hwf4" (UID: "1735a346-4506-47ef-b75d-4566d6547894") : secret "monitoring-plugin-cert" not found Jun 11 15:00:30.096636 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.096562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7n7\" (UniqueName: \"kubernetes.io/projected/1735a346-4506-47ef-b75d-4566d6547894-kube-api-access-sb7n7\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.519691 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.519656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:30.580157 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.580124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.582925 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.582902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1735a346-4506-47ef-b75d-4566d6547894-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5hwf4\" (UID: \"1735a346-4506-47ef-b75d-4566d6547894\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:30.764033 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:30.764002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:31.474482 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.473707 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:00:31.479906 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.479848 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:31.482630 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.482609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.488334 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.488004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:00:31.488334 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.488102 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:00:31.488334 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.488220 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-emguhab7fc246\"" Jun 11 15:00:31.488564 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.488339 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:00:31.489993 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.489971 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:00:31.490088 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490011 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:00:31.490228 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:00:31.490294 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490239 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:00:31.490361 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490258 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:00:31.490411 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:00:31.490411 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490210 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:00:31.490545 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490481 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:00:31.490545 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.490537 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tqn8b\"" Jun 11 15:00:31.491750 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.491709 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:00:31.491958 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.491904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:00:31.496318 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.496297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:00:31.501935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.501904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:00:31.502769 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.502752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:00:31.581268 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.581238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d"} Jun 11 15:00:31.590013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.589873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.589901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpp2l\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.589923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.589943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590013 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.589959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590399 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590399 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590399 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590399 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590622 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590622 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.590686 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.590626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.617644 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.617431 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4"] Jun 11 15:00:31.620514 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:00:31.620483 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1735a346_4506_47ef_b75d_4566d6547894.slice/crio-07c32bbeed516b5e2019c991dc7c50f878a048799ba289f2e5c884d0f10df733 WatchSource:0}: Error finding container 07c32bbeed516b5e2019c991dc7c50f878a048799ba289f2e5c884d0f10df733: Status 404 returned error can't find the container with id 07c32bbeed516b5e2019c991dc7c50f878a048799ba289f2e5c884d0f10df733 Jun 11 15:00:31.691553 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpp2l\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.691826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692067 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.691908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.692991 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.692965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.693406 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.693333 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.694014 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.693987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.694888 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.694626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.695131 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.695062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.695337 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.695196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.695703 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.695675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.695871 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.695845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.695949 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.695926 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.696699 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.696555 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.696818 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.696709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.696876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.696863 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.697024 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.696967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.697359 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.697329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.698514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.698493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.698618 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.698597 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.699453 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.699427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.699742 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.699703 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.699831 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.699809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.708505 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.708484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpp2l\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l\") pod \"prometheus-k8s-0\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.809904 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.809874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:31.832242 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.832210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:31.932936 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.932851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:31.994900 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:31.994869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:00:32.291097 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.291011 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 15:00:32.394345 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.394260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:32.490608 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.490579 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:32.587652 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.587620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe"} Jun 11 15:00:32.587801 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.587746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662"} Jun 11 15:00:32.587801 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.587792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe"} Jun 11 15:00:32.587917 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.587816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4"} Jun 11 15:00:32.587917 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.587848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerStarted","Data":"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f"} Jun 11 15:00:32.589130 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.589106 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" exitCode=0 Jun 11 15:00:32.589209 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.589188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} Jun 11 15:00:32.589270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.589255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"97911f6b9d592c9781ce8d37747887e9a7fa6d9917f2c0a3a9c6b9750becede8"} Jun 11 15:00:32.590762 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.590714 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" event={"ID":"8418cfb4-0413-4e5b-846f-b122f0e863cc","Type":"ContainerStarted","Data":"929d09e2ddd93a8e899e77119b73f73d398b1bec8d26be4c5a691e2d29390502"} Jun 11 15:00:32.590876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.590845 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:32.591838 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.591818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" event={"ID":"1735a346-4506-47ef-b75d-4566d6547894","Type":"ContainerStarted","Data":"07c32bbeed516b5e2019c991dc7c50f878a048799ba289f2e5c884d0f10df733"} Jun 11 15:00:32.592847 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.592799 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" Jun 11 15:00:32.615005 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.614966 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.974035186 podStartE2EDuration="6.614950614s" totalImagesPullingTime="4.623593335s" totalInitContainerRuntime="17.322093ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:32.612484659 +0000 UTC m=+94.933785782" watchObservedRunningTime="2026-06-11 15:00:32.614950614 +0000 UTC m=+94.936251750" Jun 11 15:00:32.666986 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:32.666936 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8dbcd7b5b-thnhb" podStartSLOduration=1.8624737009999999 podStartE2EDuration="22.666915149s" totalImagesPullingTime="20.804441448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:32.66614891 +0000 UTC m=+94.987450033" watchObservedRunningTime="2026-06-11 15:00:32.666915149 +0000 UTC m=+94.988216255" Jun 11 15:00:33.598612 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:33.598578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" event={"ID":"1735a346-4506-47ef-b75d-4566d6547894","Type":"ContainerStarted","Data":"75352b6a272264f38b1f0bf25708ba5e3c617163b1fde5e51dbffed1a7368609"} Jun 11 15:00:33.599260 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:33.599234 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:33.604595 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:33.604572 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" Jun 11 15:00:33.619881 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:33.619840 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5hwf4" podStartSLOduration=3.167896765 podStartE2EDuration="4.619826491s" totalImagesPullingTime="1.451929726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:33.619028647 +0000 UTC m=+95.940329778" watchObservedRunningTime="2026-06-11 15:00:33.619826491 +0000 UTC m=+95.941127614" Jun 11 15:00:34.659479 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:34.659446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:34.756229 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:34.756193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:34.859683 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:34.859649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:34.957876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:34.957793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:35.129248 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.129213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:35.229683 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.229605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:35.333539 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.333502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:35.434406 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.434343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:35.448673 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.448650 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kdpjp" Jun 11 15:00:35.554774 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:35.554672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:36.129946 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.129916 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:36.549406 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.549360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:36.615308 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.615277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} Jun 11 15:00:36.615456 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.615340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} Jun 11 15:00:36.674326 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.674292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:36.776225 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:36.776131 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:37.211369 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:37.211332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:37.573356 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:37.573266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:37.641186 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:37.641151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:38.626457 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:38.626420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} Jun 11 15:00:38.626868 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:38.626515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} Jun 11 15:00:38.626868 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:38.626539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} Jun 11 15:00:38.626868 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:38.626564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerStarted","Data":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} Jun 11 15:00:38.665191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:38.665145 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.234640548 podStartE2EDuration="7.665129999s" totalImagesPullingTime="5.411230736s" totalInitContainerRuntime="19.258715ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:38.662388332 +0000 UTC m=+100.983689468" watchObservedRunningTime="2026-06-11 15:00:38.665129999 +0000 UTC m=+100.986431156" Jun 11 15:00:39.106335 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:39.106270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:39.207631 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:39.207591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:41.360769 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:41.360714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:41.810800 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:41.810761 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:00:43.765459 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:43.765419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:43.847455 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:43.847413 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:45.666591 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:45.666556 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:45.735377 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:45.735345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:46.163757 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:46.163699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:46.257952 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:46.257916 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:49.759567 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:49.759532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:49.860493 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:49.860455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:53.962585 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:53.962547 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:54.056380 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:54.056340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:56.289705 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:56.289668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:56.390748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:56.390695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:56.473920 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:56.473883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:57.320601 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.320525 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" containerID="cri-o://8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376" gracePeriod=30 Jun 11 15:00:57.458867 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.458835 2581 patch_prober.go:28] interesting pod/image-registry-7458c6dc97-xwb54 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 11 15:00:57.459006 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.458887 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 11 15:00:57.565313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.565290 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:57.619496 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619402 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619496 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619479 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kfkx\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619502 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619539 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619612 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.619748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.619706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") pod \"843bbca3-33a3-4538-8b32-e59461cd7828\" (UID: \"843bbca3-33a3-4538-8b32-e59461cd7828\") " Jun 11 15:00:57.620173 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.620080 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:57.620672 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.620639 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:57.622392 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.622363 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:00:57.622507 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.622405 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:57.622581 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.622522 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx" (OuterVolumeSpecName: "kube-api-access-9kfkx") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "kube-api-access-9kfkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:57.622693 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.622673 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:57.622751 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.622691 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:00:57.628358 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.628333 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "843bbca3-33a3-4538-8b32-e59461cd7828" (UID: "843bbca3-33a3-4538-8b32-e59461cd7828"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:00:57.701341 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.701312 2581 generic.go:356] "Generic (PLEG): container finished" podID="843bbca3-33a3-4538-8b32-e59461cd7828" containerID="8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376" exitCode=0 Jun 11 15:00:57.701493 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.701360 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" Jun 11 15:00:57.701493 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.701365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" event={"ID":"843bbca3-33a3-4538-8b32-e59461cd7828","Type":"ContainerDied","Data":"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376"} Jun 11 15:00:57.701493 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.701404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458c6dc97-xwb54" event={"ID":"843bbca3-33a3-4538-8b32-e59461cd7828","Type":"ContainerDied","Data":"c6d9559ac2b99d20deff2b95d9eaa8edf3b22e904b4a764e7c7f81f217d35b82"} Jun 11 15:00:57.701493 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.701424 2581 scope.go:117] "RemoveContainer" containerID="8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376" Jun 11 15:00:57.709898 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.709878 2581 scope.go:117] "RemoveContainer" containerID="8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376" Jun 11 15:00:57.710149 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:00:57.710131 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376\": container with ID starting with 8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376 not found: ID does not exist" containerID="8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376" Jun 11 15:00:57.710195 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.710158 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376"} err="failed to get container status \"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376\": rpc error: code = NotFound desc = could not find container \"8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376\": container with ID starting with 8c9a1a3483bac27499b6e9ab1c2cf9ad2acebcdfa5186764c5b294fb0932b376 not found: ID does not exist" Jun 11 15:00:57.720668 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720648 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-registry-tls\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720670 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-image-registry-private-configuration\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720681 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kfkx\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-kube-api-access-9kfkx\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720692 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/843bbca3-33a3-4538-8b32-e59461cd7828-installation-pull-secrets\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720701 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/843bbca3-33a3-4538-8b32-e59461cd7828-ca-trust-extracted\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720714 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/843bbca3-33a3-4538-8b32-e59461cd7828-bound-sa-token\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720748 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-registry-certificates\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.720851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.720763 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/843bbca3-33a3-4538-8b32-e59461cd7828-trusted-ca\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:00:57.722553 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.722533 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 15:00:57.726389 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:57.726368 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7458c6dc97-xwb54"] Jun 11 15:00:58.148159 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:58.148128 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" path="/var/lib/kubelet/pods/843bbca3-33a3-4538-8b32-e59461cd7828/volumes" Jun 11 15:00:58.567384 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:58.567344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:00:58.673592 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:00:58.673559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:00.561896 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:00.561850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:00.663098 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:00.663059 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:04.196433 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:04.196392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:04.270259 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:04.270222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:04.728872 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:04.728838 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d77a079-124b-4718-81f2-0774f58289d9" containerID="3de7445fadab202f1496d39953e3e7baa601e1f71375535b41243779daf35fda" exitCode=0 Jun 11 15:01:04.729032 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:04.728912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-b7s4j" event={"ID":"0d77a079-124b-4718-81f2-0774f58289d9","Type":"ContainerDied","Data":"3de7445fadab202f1496d39953e3e7baa601e1f71375535b41243779daf35fda"} Jun 11 15:01:04.729286 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:04.729272 2581 scope.go:117] "RemoveContainer" containerID="3de7445fadab202f1496d39953e3e7baa601e1f71375535b41243779daf35fda" Jun 11 15:01:05.734066 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:05.734029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-b7s4j" event={"ID":"0d77a079-124b-4718-81f2-0774f58289d9","Type":"ContainerStarted","Data":"c3b5d7a3c0c4f8ede13e826ad3915bf6e01682cac65d90de1e38a458d9826371"} Jun 11 15:01:19.196170 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:19.196132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:19.260369 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:19.260339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:31.810423 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:31.810381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:31.834098 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:31.834070 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:31.850331 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:31.850308 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:44.458842 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:44.458800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:44.962694 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:44.962655 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:45.497571 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.497539 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:45.497976 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.497829 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="alertmanager" containerID="cri-o://28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" gracePeriod=120 Jun 11 15:01:45.497976 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.497912 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-metric" containerID="cri-o://0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" gracePeriod=120 Jun 11 15:01:45.497976 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.497925 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="prom-label-proxy" containerID="cri-o://54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" gracePeriod=120 Jun 11 15:01:45.498150 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.497975 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="config-reloader" containerID="cri-o://cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" gracePeriod=120 Jun 11 15:01:45.498150 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.498022 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy" containerID="cri-o://a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" gracePeriod=120 Jun 11 15:01:45.498150 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.498064 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-web" containerID="cri-o://2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" gracePeriod=120 Jun 11 15:01:45.892287 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892224 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" exitCode=0 Jun 11 15:01:45.892287 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892249 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" exitCode=0 Jun 11 15:01:45.892287 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892258 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" exitCode=0 Jun 11 15:01:45.892287 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892264 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" exitCode=0 Jun 11 15:01:45.892483 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe"} Jun 11 15:01:45.892483 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe"} Jun 11 15:01:45.892483 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f"} Jun 11 15:01:45.892483 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:45.892411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d"} Jun 11 15:01:46.745394 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.745371 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:46.899134 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899046 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" exitCode=0 Jun 11 15:01:46.899134 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899075 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerID="2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" exitCode=0 Jun 11 15:01:46.899134 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662"} Jun 11 15:01:46.899134 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899132 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:46.899413 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4"} Jun 11 15:01:46.899413 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3f0f63e1-1385-449a-b6ed-c220b084f0a9","Type":"ContainerDied","Data":"fd6fab9e76ff6f9f0194d06537351537d702e743712f69bf8c18590aaa079ca7"} Jun 11 15:01:46.899413 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.899312 2581 scope.go:117] "RemoveContainer" containerID="54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" Jun 11 15:01:46.906557 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.906542 2581 scope.go:117] "RemoveContainer" containerID="0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" Jun 11 15:01:46.913152 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.913131 2581 scope.go:117] "RemoveContainer" containerID="a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" Jun 11 15:01:46.919593 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.919579 2581 scope.go:117] "RemoveContainer" containerID="2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" Jun 11 15:01:46.921500 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921482 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921602 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921518 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921602 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921554 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921602 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921581 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921786 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921615 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921786 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921656 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921786 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921699 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jg27\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921920 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921903 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921978 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921943 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.921978 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.921973 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.922077 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922000 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:46.922077 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.922179 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.922933 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922231 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls\") pod \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\" (UID: \"3f0f63e1-1385-449a-b6ed-c220b084f0a9\") " Jun 11 15:01:46.922933 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922269 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:46.922933 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922480 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-metrics-client-ca\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:46.922933 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922499 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-main-db\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:46.922933 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.922889 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:46.925124 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.925095 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.925757 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.925714 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out" (OuterVolumeSpecName: "config-out") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:46.926207 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926180 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27" (OuterVolumeSpecName: "kube-api-access-2jg27") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "kube-api-access-2jg27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:46.926346 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926318 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.926761 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926700 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.926861 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926831 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:46.926935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926902 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.926935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.926918 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume" (OuterVolumeSpecName: "config-volume") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.928270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.928236 2581 scope.go:117] "RemoveContainer" containerID="cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" Jun 11 15:01:46.931083 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.931059 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.937825 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.937804 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config" (OuterVolumeSpecName: "web-config") pod "3f0f63e1-1385-449a-b6ed-c220b084f0a9" (UID: "3f0f63e1-1385-449a-b6ed-c220b084f0a9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:46.938517 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.938500 2581 scope.go:117] "RemoveContainer" containerID="28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" Jun 11 15:01:46.945019 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.945005 2581 scope.go:117] "RemoveContainer" containerID="77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc" Jun 11 15:01:46.951624 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.951607 2581 scope.go:117] "RemoveContainer" containerID="54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" Jun 11 15:01:46.951895 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.951878 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe\": container with ID starting with 54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe not found: ID does not exist" containerID="54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" Jun 11 15:01:46.951951 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.951907 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe"} err="failed to get container status \"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe\": rpc error: code = NotFound desc = could not find container \"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe\": container with ID starting with 54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe not found: ID does not exist" Jun 11 15:01:46.951951 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.951924 2581 scope.go:117] "RemoveContainer" containerID="0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" Jun 11 15:01:46.952174 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.952156 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662\": container with ID starting with 0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662 not found: ID does not exist" containerID="0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" Jun 11 15:01:46.952211 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952180 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662"} err="failed to get container status \"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662\": rpc error: code = NotFound desc = could not find container \"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662\": container with ID starting with 0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662 not found: ID does not exist" Jun 11 15:01:46.952211 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952196 2581 scope.go:117] "RemoveContainer" containerID="a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" Jun 11 15:01:46.952425 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.952407 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe\": container with ID starting with a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe not found: ID does not exist" containerID="a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" Jun 11 15:01:46.952492 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952433 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe"} err="failed to get container status \"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe\": rpc error: code = NotFound desc = could not find container \"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe\": container with ID starting with a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe not found: ID does not exist" Jun 11 15:01:46.952492 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952455 2581 scope.go:117] "RemoveContainer" containerID="2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" Jun 11 15:01:46.952697 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.952682 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4\": container with ID starting with 2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4 not found: ID does not exist" containerID="2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" Jun 11 15:01:46.952854 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952702 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4"} err="failed to get container status \"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4\": rpc error: code = NotFound desc = could not find container \"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4\": container with ID starting with 2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4 not found: ID does not exist" Jun 11 15:01:46.952854 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.952715 2581 scope.go:117] "RemoveContainer" containerID="cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" Jun 11 15:01:46.953036 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.953019 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f\": container with ID starting with cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f not found: ID does not exist" containerID="cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" Jun 11 15:01:46.953078 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953039 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f"} err="failed to get container status \"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f\": rpc error: code = NotFound desc = could not find container \"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f\": container with ID starting with cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f not found: ID does not exist" Jun 11 15:01:46.953078 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953052 2581 scope.go:117] "RemoveContainer" containerID="28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" Jun 11 15:01:46.953257 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.953241 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d\": container with ID starting with 28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d not found: ID does not exist" containerID="28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" Jun 11 15:01:46.953315 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953265 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d"} err="failed to get container status \"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d\": rpc error: code = NotFound desc = could not find container \"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d\": container with ID starting with 28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d not found: ID does not exist" Jun 11 15:01:46.953315 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953285 2581 scope.go:117] "RemoveContainer" containerID="77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc" Jun 11 15:01:46.953500 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:46.953481 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc\": container with ID starting with 77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc not found: ID does not exist" containerID="77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc" Jun 11 15:01:46.953540 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953506 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc"} err="failed to get container status \"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc\": rpc error: code = NotFound desc = could not find container \"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc\": container with ID starting with 77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc not found: ID does not exist" Jun 11 15:01:46.953540 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953517 2581 scope.go:117] "RemoveContainer" containerID="54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe" Jun 11 15:01:46.953689 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953663 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe"} err="failed to get container status \"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe\": rpc error: code = NotFound desc = could not find container \"54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe\": container with ID starting with 54fb97e849e0cb6c620dfba4ca9b42bd87fcbb9af8f1fa1364da8a1ef5ebebbe not found: ID does not exist" Jun 11 15:01:46.953785 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953690 2581 scope.go:117] "RemoveContainer" containerID="0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662" Jun 11 15:01:46.953944 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953925 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662"} err="failed to get container status \"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662\": rpc error: code = NotFound desc = could not find container \"0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662\": container with ID starting with 0e10d3c4dbe61166b962c1288c94f385f842e0168be21d8a25065e6b661e9662 not found: ID does not exist" Jun 11 15:01:46.954010 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.953945 2581 scope.go:117] "RemoveContainer" containerID="a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe" Jun 11 15:01:46.954143 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954121 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe"} err="failed to get container status \"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe\": rpc error: code = NotFound desc = could not find container \"a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe\": container with ID starting with a342f834d6928bd3a4976cd192f4f2f811919cc98baead8750d5feed567668fe not found: ID does not exist" Jun 11 15:01:46.954183 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954145 2581 scope.go:117] "RemoveContainer" containerID="2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4" Jun 11 15:01:46.954350 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954332 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4"} err="failed to get container status \"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4\": rpc error: code = NotFound desc = could not find container \"2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4\": container with ID starting with 2b2b55dc9ff7a6359c6914f3ee58191a7574b9aeeae14ab1216eb6fc66c8add4 not found: ID does not exist" Jun 11 15:01:46.954418 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954352 2581 scope.go:117] "RemoveContainer" containerID="cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f" Jun 11 15:01:46.954614 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954597 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f"} err="failed to get container status \"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f\": rpc error: code = NotFound desc = could not find container \"cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f\": container with ID starting with cbda667fc62d4ca130eb5e8a6041d64e7c5100f296e0895fbc2f4f3ea824ee6f not found: ID does not exist" Jun 11 15:01:46.954656 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954615 2581 scope.go:117] "RemoveContainer" containerID="28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d" Jun 11 15:01:46.954830 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954811 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d"} err="failed to get container status \"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d\": rpc error: code = NotFound desc = could not find container \"28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d\": container with ID starting with 28169318f983a1580cefc7ad93611f59daabc62626a023d3f083e9f7ea9ec86d not found: ID does not exist" Jun 11 15:01:46.954901 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.954830 2581 scope.go:117] "RemoveContainer" containerID="77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc" Jun 11 15:01:46.955038 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:46.955015 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc"} err="failed to get container status \"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc\": rpc error: code = NotFound desc = could not find container \"77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc\": container with ID starting with 77af0665018be8c6f9c5a501d23dfee05f47e99c3c08687a3d0f45d2dda882cc not found: ID does not exist" Jun 11 15:01:47.022858 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022829 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-main-tls\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.022858 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022852 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-cluster-tls-config\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022863 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022890 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-web-config\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022905 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022917 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jg27\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-kube-api-access-2jg27\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022925 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f0f63e1-1385-449a-b6ed-c220b084f0a9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022934 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f0f63e1-1385-449a-b6ed-c220b084f0a9-tls-assets\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022942 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-volume\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022949 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f0f63e1-1385-449a-b6ed-c220b084f0a9-config-out\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.023004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.022957 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3f0f63e1-1385-449a-b6ed-c220b084f0a9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:47.223031 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.223002 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:47.227459 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.227435 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:47.249872 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.249846 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:47.250109 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250098 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250110 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250120 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-web" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250126 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-web" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250134 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-metric" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250139 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-metric" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250149 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="alertmanager" Jun 11 15:01:47.250153 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250154 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="alertmanager" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250160 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250165 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250171 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="prom-label-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250176 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="prom-label-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250183 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="init-config-reloader" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250188 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="init-config-reloader" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250193 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="config-reloader" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250198 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="config-reloader" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250242 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250250 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-metric" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250255 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="config-reloader" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250261 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="prom-label-proxy" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250267 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="alertmanager" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250272 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="843bbca3-33a3-4538-8b32-e59461cd7828" containerName="registry" Jun 11 15:01:47.250353 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.250277 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" containerName="kube-rbac-proxy-web" Jun 11 15:01:47.253961 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.253944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.257012 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.256985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257905 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t2cj7\"" Jun 11 15:01:47.258036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.257846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:01:47.258377 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.258290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:01:47.258377 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.258304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:01:47.261973 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.261956 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:01:47.272154 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.272132 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:47.425851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.425968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.425968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.425968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.425968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.425968 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkx74\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-kube-api-access-xkx74\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426139 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.425976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426139 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426139 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426139 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426139 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426280 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.426280 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.426175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.527339 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.527339 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.527339 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkx74\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-kube-api-access-xkx74\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.528176 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.527876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.529006 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.528571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530523 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530810 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a91932-68d2-49d0-b978-86241ba866ff-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.530997 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.530975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.531249 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.531232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.531501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.531475 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a91932-68d2-49d0-b978-86241ba866ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.532102 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.532078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.532973 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.532950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a91932-68d2-49d0-b978-86241ba866ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.537002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.536977 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkx74\" (UniqueName: \"kubernetes.io/projected/c2a91932-68d2-49d0-b978-86241ba866ff-kube-api-access-xkx74\") pod \"alertmanager-main-0\" (UID: \"c2a91932-68d2-49d0-b978-86241ba866ff\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.564673 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.564649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:01:47.697916 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.697890 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:01:47.699694 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:01:47.699665 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a91932_68d2_49d0_b978_86241ba866ff.slice/crio-72b4e4fcb94cfb96b4ceb00c1fe046c9833a3cc953d37c4b97261d62cc7ffeb8 WatchSource:0}: Error finding container 72b4e4fcb94cfb96b4ceb00c1fe046c9833a3cc953d37c4b97261d62cc7ffeb8: Status 404 returned error can't find the container with id 72b4e4fcb94cfb96b4ceb00c1fe046c9833a3cc953d37c4b97261d62cc7ffeb8 Jun 11 15:01:47.905426 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.905395 2581 generic.go:356] "Generic (PLEG): container finished" podID="c2a91932-68d2-49d0-b978-86241ba866ff" containerID="6bb9e2ea5f0e25c2c638050b0ace1c77f484b960848878556bd5fe741f150d74" exitCode=0 Jun 11 15:01:47.905758 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.905483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerDied","Data":"6bb9e2ea5f0e25c2c638050b0ace1c77f484b960848878556bd5fe741f150d74"} Jun 11 15:01:47.905758 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:47.905552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"72b4e4fcb94cfb96b4ceb00c1fe046c9833a3cc953d37c4b97261d62cc7ffeb8"} Jun 11 15:01:48.151800 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.151769 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0f63e1-1385-449a-b6ed-c220b084f0a9" path="/var/lib/kubelet/pods/3f0f63e1-1385-449a-b6ed-c220b084f0a9/volumes" Jun 11 15:01:48.912523 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"fe4a603516f7d3d23db010f453fa72a3bf7ebc2fc108b2159ed08ba293a8e71d"} Jun 11 15:01:48.912935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"55d860cce6d732695193255f5ff52cdaf26c1c9f2403b2706a01eb8da1855e67"} Jun 11 15:01:48.912935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"cd9ea138814ccdb29a47e3b8c16abc1feebb32c38f8874568eafc68a95143d0c"} Jun 11 15:01:48.912935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"dc90b98a1dcfb79fecb17be142cfd0f8324600573e2c97a46c1bc219e71a76b3"} Jun 11 15:01:48.912935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"e21b36029a922f00b11b55b36e5cfe1f9071bb49030ade0b6543fbdd6de6340a"} Jun 11 15:01:48.912935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.912664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a91932-68d2-49d0-b978-86241ba866ff","Type":"ContainerStarted","Data":"baa212a3a377bf9e8deb4e0481ba76d84702848d275e88afe3c5d4289aec46dc"} Jun 11 15:01:48.945443 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:48.945388 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.9278899059999999 podStartE2EDuration="1.945371008s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.481102ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:48.943803435 +0000 UTC m=+171.265104561" watchObservedRunningTime="2026-06-11 15:01:48.945371008 +0000 UTC m=+171.266672132" Jun 11 15:01:49.544838 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.544801 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v"] Jun 11 15:01:49.548002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.547977 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.550913 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.550880 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 15:01:49.551037 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.550888 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 15:01:49.551037 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.550957 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9lgv6\"" Jun 11 15:01:49.551210 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.551181 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 15:01:49.551327 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.551239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 15:01:49.551327 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.551269 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 15:01:49.557872 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.557851 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 15:01:49.562846 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.562822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v"] Jun 11 15:01:49.644242 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-metrics-client-ca\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-serving-certs-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644417 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmnx\" (UniqueName: \"kubernetes.io/projected/493961c2-f3bd-4cea-be3b-8201cf1baf34-kube-api-access-cpmnx\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.644753 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.644427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-federate-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.744976 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.744940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-federate-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.744992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-metrics-client-ca\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-serving-certs-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745367 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.745367 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.745173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmnx\" (UniqueName: \"kubernetes.io/projected/493961c2-f3bd-4cea-be3b-8201cf1baf34-kube-api-access-cpmnx\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.746063 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.746012 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-serving-certs-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.746200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.746065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-metrics-client-ca\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.746408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.746387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.747791 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.747771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-federate-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.748119 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.748095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.748389 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.748369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-telemeter-client-tls\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.748432 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.748369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/493961c2-f3bd-4cea-be3b-8201cf1baf34-secret-telemeter-client\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.753499 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.753479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmnx\" (UniqueName: \"kubernetes.io/projected/493961c2-f3bd-4cea-be3b-8201cf1baf34-kube-api-access-cpmnx\") pod \"telemeter-client-6bc9d99c5d-w4j2v\" (UID: \"493961c2-f3bd-4cea-be3b-8201cf1baf34\") " pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:49.809608 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809518 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:49.809977 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809902 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="prometheus" containerID="cri-o://4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" gracePeriod=600 Jun 11 15:01:49.809977 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809921 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="thanos-sidecar" containerID="cri-o://c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" gracePeriod=600 Jun 11 15:01:49.809977 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809939 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="config-reloader" containerID="cri-o://4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" gracePeriod=600 Jun 11 15:01:49.810192 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809960 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" gracePeriod=600 Jun 11 15:01:49.810192 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809914 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy" containerID="cri-o://24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" gracePeriod=600 Jun 11 15:01:49.810192 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.809944 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-web" containerID="cri-o://a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" gracePeriod=600 Jun 11 15:01:49.859691 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:49.859623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" Jun 11 15:01:50.017576 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.017378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v"] Jun 11 15:01:50.022115 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:01:50.022074 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493961c2_f3bd_4cea_be3b_8201cf1baf34.slice/crio-00d0d44a20e03cc81664427c112ff14c1dee48f2ee2ff61823fb9ef8fed66467 WatchSource:0}: Error finding container 00d0d44a20e03cc81664427c112ff14c1dee48f2ee2ff61823fb9ef8fed66467: Status 404 returned error can't find the container with id 00d0d44a20e03cc81664427c112ff14c1dee48f2ee2ff61823fb9ef8fed66467 Jun 11 15:01:50.094072 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.094050 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:50.249073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249043 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249078 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249097 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249121 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249146 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249216 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249238 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249271 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249312 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249302 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249334 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249371 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249396 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249423 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249498 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249528 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpp2l\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.249812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249623 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file\") pod \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\" (UID: \"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc\") " Jun 11 15:01:50.250293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249467 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.250293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249535 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.250293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249556 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.250293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.249595 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.250293 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.250095 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.250563 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.250287 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:50.251961 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.251061 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.252078 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.252012 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.252594 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.252326 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:01:50.252711 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.252643 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.253036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.252820 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.253036 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.252851 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:50.253295 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253265 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l" (OuterVolumeSpecName: "kube-api-access-cpp2l") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "kube-api-access-cpp2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:50.253511 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253330 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.253599 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253571 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253599 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253595 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253610 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-grpc-tls\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253625 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253640 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253655 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-db\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253669 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253691 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253706 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-configmap-metrics-client-ca\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253753 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253768 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-kube-rbac-proxy\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.253783 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253780 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.254289 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.253852 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.254361 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.254339 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config" (OuterVolumeSpecName: "config") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.254792 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.254761 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.255016 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.254997 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.255129 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.255114 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out" (OuterVolumeSpecName: "config-out") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:01:50.264540 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.264520 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config" (OuterVolumeSpecName: "web-config") pod "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" (UID: "e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:01:50.354202 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354151 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-tls-assets\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354202 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354171 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354202 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354182 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-web-config\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354202 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354197 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config-out\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354207 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-config\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354214 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpp2l\" (UniqueName: \"kubernetes.io/projected/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-kube-api-access-cpp2l\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354222 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-secret-metrics-client-certs\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.354371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.354230 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:01:50.924758 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924707 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" exitCode=0 Jun 11 15:01:50.924758 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924752 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" exitCode=0 Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924765 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" exitCode=0 Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924780 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" exitCode=0 Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924788 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" exitCode=0 Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924794 2581 generic.go:356] "Generic (PLEG): container finished" podID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" exitCode=0 Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924806 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} Jun 11 15:01:50.924937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} Jun 11 15:01:50.925329 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924959 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.925329 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.924960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} Jun 11 15:01:50.925329 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.925104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} Jun 11 15:01:50.925329 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.925173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} Jun 11 15:01:50.925329 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.925219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc","Type":"ContainerDied","Data":"97911f6b9d592c9781ce8d37747887e9a7fa6d9917f2c0a3a9c6b9750becede8"} Jun 11 15:01:50.926535 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.926181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" event={"ID":"493961c2-f3bd-4cea-be3b-8201cf1baf34","Type":"ContainerStarted","Data":"00d0d44a20e03cc81664427c112ff14c1dee48f2ee2ff61823fb9ef8fed66467"} Jun 11 15:01:50.933860 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.933837 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.940908 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.940892 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.947463 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.947449 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.950990 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.950970 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:50.954279 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.954262 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.958561 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.958539 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:50.961662 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.961646 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.969497 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.969482 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.977711 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.977689 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.978018 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.977999 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.978108 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978024 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.978108 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978041 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.978296 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.978268 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.978352 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.978352 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978321 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.978568 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.978550 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.978604 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978575 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.978604 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978597 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.978853 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.978833 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.978955 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978857 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.978955 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.978877 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.979119 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.979105 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.979199 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979122 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.979199 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979140 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.979353 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.979338 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.979398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979357 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.979398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979371 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.979605 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:01:50.979587 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.979671 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979613 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.979671 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979632 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.979855 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979836 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.979908 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.979856 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.980065 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980044 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.980112 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980066 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.980219 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980201 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.980284 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980221 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.980436 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980417 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.980503 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980437 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.980620 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980603 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.980694 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980622 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.980844 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980828 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.980906 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.980845 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.981050 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981034 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.981088 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981049 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.981251 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981225 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.981251 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981244 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.981659 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981629 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.981894 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.981706 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.982618 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.982590 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.982754 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.982619 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.982932 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.982893 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.983043 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.982932 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.983294 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983259 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.983294 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983285 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.983547 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983524 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.983633 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983549 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.983819 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983786 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.983819 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.983809 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.984035 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984017 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.984035 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984035 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.984387 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984345 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.984387 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984375 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.984387 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984382 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:50.984688 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984660 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.984814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984689 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.984814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984775 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="init-config-reloader" Jun 11 15:01:50.984814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984792 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="init-config-reloader" Jun 11 15:01:50.984814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984808 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy" Jun 11 15:01:50.984814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984816 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984829 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="prometheus" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984837 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="prometheus" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984848 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="thanos-sidecar" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984856 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="thanos-sidecar" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984868 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-web" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984876 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-web" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984885 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-thanos" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984893 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-thanos" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984910 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="config-reloader" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984918 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="config-reloader" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.984999 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-web" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985011 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy-thanos" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985023 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="kube-rbac-proxy" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985031 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="prometheus" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985039 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="thanos-sidecar" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985049 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" containerName="config-reloader" Jun 11 15:01:50.985116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985043 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.985923 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.985132 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.986255 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986232 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.986255 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986256 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.986536 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986511 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.986606 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986538 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.986896 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986871 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.986896 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.986896 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.987141 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987121 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.987141 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987140 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.987421 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987391 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.987421 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987420 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.987715 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987683 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.987715 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.987711 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.988024 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988003 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.988079 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988028 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.988281 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988256 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.988365 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988282 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.989002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988909 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.989002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.988935 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.989170 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.989132 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:50.989273 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.989245 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.989273 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.989270 2581 scope.go:117] "RemoveContainer" containerID="4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48" Jun 11 15:01:50.992208 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992180 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48"} err="failed to get container status \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": rpc error: code = NotFound desc = could not find container \"4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48\": container with ID starting with 4411c517d669dde1838443542b27e5ac054c0728c51f85222e3d0533f8eb1e48 not found: ID does not exist" Jun 11 15:01:50.992339 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992208 2581 scope.go:117] "RemoveContainer" containerID="24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0" Jun 11 15:01:50.992534 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992480 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0"} err="failed to get container status \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": rpc error: code = NotFound desc = could not find container \"24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0\": container with ID starting with 24821fe7f6a05b04e8251e8f2f7b154af8f2c52ac5b919102531748e2baee2b0 not found: ID does not exist" Jun 11 15:01:50.992534 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992505 2581 scope.go:117] "RemoveContainer" containerID="a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897" Jun 11 15:01:50.992745 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992708 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:01:50.992820 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.992778 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:01:50.993021 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993002 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:01:50.993021 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:01:50.993221 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:01:50.993296 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:01:50.993375 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993302 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:01:50.993375 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993364 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:01:50.993497 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993303 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-emguhab7fc246\"" Jun 11 15:01:50.993558 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993527 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897"} err="failed to get container status \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": rpc error: code = NotFound desc = could not find container \"a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897\": container with ID starting with a042457aef10843ff58e32de3667a86bbca2ff7d74c435de6586d861edc4e897 not found: ID does not exist" Jun 11 15:01:50.993616 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993560 2581 scope.go:117] "RemoveContainer" containerID="c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221" Jun 11 15:01:50.993929 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993852 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221"} err="failed to get container status \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": rpc error: code = NotFound desc = could not find container \"c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221\": container with ID starting with c604119d86655be4e3df3affffc18e5ff9292737d03653b60d686012489bb221 not found: ID does not exist" Jun 11 15:01:50.993929 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.993880 2581 scope.go:117] "RemoveContainer" containerID="4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5" Jun 11 15:01:50.994078 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tqn8b\"" Jun 11 15:01:50.994078 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994063 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:01:50.994191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994177 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:01:50.994272 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994257 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:01:50.994556 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994526 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:01:50.994691 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:01:50.994851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994784 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5"} err="failed to get container status \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": rpc error: code = NotFound desc = could not find container \"4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5\": container with ID starting with 4b620163f46e988e7dd57945fec9b2934a4ccc7df11a4c3059d4205ff6a30fd5 not found: ID does not exist" Jun 11 15:01:50.994851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.994808 2581 scope.go:117] "RemoveContainer" containerID="4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b" Jun 11 15:01:50.996371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.995748 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b"} err="failed to get container status \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": rpc error: code = NotFound desc = could not find container \"4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b\": container with ID starting with 4c87725b9f0ce246323d4a33992a214b38192735d1953c3d6132addaf5ecfd2b not found: ID does not exist" Jun 11 15:01:50.996371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.995772 2581 scope.go:117] "RemoveContainer" containerID="04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446" Jun 11 15:01:50.999072 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.997302 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446"} err="failed to get container status \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": rpc error: code = NotFound desc = could not find container \"04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446\": container with ID starting with 04dc5c314c04393442bb5705b673e41f6d456d4aee8ac5fd72070b4144d74446 not found: ID does not exist" Jun 11 15:01:50.999072 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:50.998126 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:01:51.002069 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.001893 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:01:51.007483 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.007434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:51.059646 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-web-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.059993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6jg\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-kube-api-access-7v6jg\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-config-out\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.060408 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.060373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161278 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161371 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161541 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161576 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161622 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161622 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161764 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161764 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161764 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161918 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161918 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161918 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161918 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-web-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.161918 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6jg\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-kube-api-access-7v6jg\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.162169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.162169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.161977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-config-out\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.162169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.162030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.162169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.162047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.162361 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.162200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.163374 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.163063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.163374 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.163157 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.164648 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.164620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.164760 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.164643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.164829 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.164790 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-config-out\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.164893 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.164876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.165573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.164952 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.165573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.165104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-web-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.165573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.165119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.165573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.165394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.166233 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.166001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.166325 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.166296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.166378 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.166343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.166615 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.166588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.167343 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.167323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.168263 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.168243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.168389 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.168361 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e592cdd8-eff0-48d9-8a55-43a20f758442-config\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.168944 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.168923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e592cdd8-eff0-48d9-8a55-43a20f758442-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.173379 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.173358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6jg\" (UniqueName: \"kubernetes.io/projected/e592cdd8-eff0-48d9-8a55-43a20f758442-kube-api-access-7v6jg\") pod \"prometheus-k8s-0\" (UID: \"e592cdd8-eff0-48d9-8a55-43a20f758442\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.303391 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.303328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:01:51.449784 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.449752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:01:51.450123 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:01:51.450099 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode592cdd8_eff0_48d9_8a55_43a20f758442.slice/crio-b3d8f1c06b216aba8451f0ba7bbfdd16aa6d639a3b8a5bec6934805346440b71 WatchSource:0}: Error finding container b3d8f1c06b216aba8451f0ba7bbfdd16aa6d639a3b8a5bec6934805346440b71: Status 404 returned error can't find the container with id b3d8f1c06b216aba8451f0ba7bbfdd16aa6d639a3b8a5bec6934805346440b71 Jun 11 15:01:51.932377 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.932347 2581 generic.go:356] "Generic (PLEG): container finished" podID="e592cdd8-eff0-48d9-8a55-43a20f758442" containerID="4441a48b812a0bc085de4f303a2e6842352f51651393a60ab64d63adc30b8b2f" exitCode=0 Jun 11 15:01:51.932514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.932398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerDied","Data":"4441a48b812a0bc085de4f303a2e6842352f51651393a60ab64d63adc30b8b2f"} Jun 11 15:01:51.932514 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:51.932445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"b3d8f1c06b216aba8451f0ba7bbfdd16aa6d639a3b8a5bec6934805346440b71"} Jun 11 15:01:52.157073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.154606 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc" path="/var/lib/kubelet/pods/e4f143fd-e3e8-40b2-a8b2-84a21d8b3ebc/volumes" Jun 11 15:01:52.938660 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.938627 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" event={"ID":"493961c2-f3bd-4cea-be3b-8201cf1baf34","Type":"ContainerStarted","Data":"9a1843ca503d0dd5f7d644e25ba65d1a3f802af36c268116b55f29241cf3c20c"} Jun 11 15:01:52.938819 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.938690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" event={"ID":"493961c2-f3bd-4cea-be3b-8201cf1baf34","Type":"ContainerStarted","Data":"6d01db0984664a237b191b3df39003d6cd4a8a0649cabbe66e2eaef4c804c061"} Jun 11 15:01:52.938819 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.938745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" event={"ID":"493961c2-f3bd-4cea-be3b-8201cf1baf34","Type":"ContainerStarted","Data":"086ba064dbc2dfec5b70e4a1b99844c7b16ca48ab81a076c4eae8cd7ab3de76d"} Jun 11 15:01:52.941828 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.941803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"6fe5cbb34a12b13f71a57bf8129cc966e438628735f1630f1d3dccb70d148f7d"} Jun 11 15:01:52.941910 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.941873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"7e3768caaec057dc00426a974a71ef99e10ccc3af34be301700a7b620eff4c7d"} Jun 11 15:01:52.941960 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.941914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"70fdd47d9b3504cbb57c667f538c34da8bf92a5120abb8d9ee94a33da4b1e6de"} Jun 11 15:01:52.941992 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.941956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"ad6cdf3e287be1db2a20a1f190935ac470f53786d10b4c01e14206187c623506"} Jun 11 15:01:52.941992 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.941984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"5e58cc4afabb2fb9da07f7cdc5bcfb30b2912a6c5e459984246ea18b6dba09dc"} Jun 11 15:01:52.942049 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.942006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e592cdd8-eff0-48d9-8a55-43a20f758442","Type":"ContainerStarted","Data":"56ff751b53427d0a6e6d917b0bbc893a776f841704b00b9cd2684e17ba37414d"} Jun 11 15:01:52.961486 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.961436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bc9d99c5d-w4j2v" podStartSLOduration=1.355856566 podStartE2EDuration="3.961422411s" totalImagesPullingTime="2.605565845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:52.958814555 +0000 UTC m=+175.280115680" watchObservedRunningTime="2026-06-11 15:01:52.961422411 +0000 UTC m=+175.282723589" Jun 11 15:01:52.985952 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:52.985913 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.961966962 podStartE2EDuration="2.985898871s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.931909ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:52.983901785 +0000 UTC m=+175.305202934" watchObservedRunningTime="2026-06-11 15:01:52.985898871 +0000 UTC m=+175.307199994" Jun 11 15:01:54.024459 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:54.024418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:54.091894 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:54.091860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:01:56.303497 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:01:56.303465 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:02:04.579627 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:04.579577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:04.641534 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:04.641503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:04.707558 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:04.707528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:29.391809 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:29.391769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:51.304431 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:51.304385 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:02:51.322066 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:51.322042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:02:52.204473 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:52.204445 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:02:59.713806 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:59.713766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:59.815892 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:02:59.815860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:03.349703 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:03.349662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:03.450829 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:03.450792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:11.694793 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:11.694692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:11.794330 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:11.794287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:13.821117 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:13.821082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:13.921406 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:13.921378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:14.008196 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:14.008166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:19.258203 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:19.258161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:19.369221 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:19.369183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:40.118216 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:40.118164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:03:58.108313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:58.108286 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:03:58.110454 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:03:58.110424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:04:03.116896 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:04:03.116864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:04:22.804474 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:04:22.804431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:04:22.931467 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:04:22.931435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:04.928116 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:04.928081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:05.239628 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:05.239538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:09.640428 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:09.640392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:09.838001 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:09.837971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:12.840805 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:12.840762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:12.999586 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:12.999551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:13.626560 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:13.626524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:14.120859 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:14.120829 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:14.502534 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:14.502504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:16.137359 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:16.137327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:16.500472 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:16.500441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:19.962536 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.962500 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx"] Jun 11 15:05:19.965468 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.965452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:19.969667 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.969646 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 15:05:19.973270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.973246 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7klhd\"" Jun 11 15:05:19.979999 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.979986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 15:05:19.992716 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:19.992693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx"] Jun 11 15:05:20.044799 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.044771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.044915 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.044827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fshgn\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-kube-api-access-fshgn\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.145208 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.145188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.145308 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.145218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fshgn\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-kube-api-access-fshgn\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.173979 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.173955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.174124 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.174075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fshgn\" (UniqueName: \"kubernetes.io/projected/69141646-94bf-4f92-94a6-e157b68bb8de-kube-api-access-fshgn\") pod \"cert-manager-cainjector-5d99449ffd-8wtsx\" (UID: \"69141646-94bf-4f92-94a6-e157b68bb8de\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.285315 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.285260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" Jun 11 15:05:20.448426 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.448390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx"] Jun 11 15:05:20.453037 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:05:20.453012 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69141646_94bf_4f92_94a6_e157b68bb8de.slice/crio-19a25cc79e326af69ca2159a43d0b336af3e1e8b80b154fff2733411073670e9 WatchSource:0}: Error finding container 19a25cc79e326af69ca2159a43d0b336af3e1e8b80b154fff2733411073670e9: Status 404 returned error can't find the container with id 19a25cc79e326af69ca2159a43d0b336af3e1e8b80b154fff2733411073670e9 Jun 11 15:05:20.455384 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.455368 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:05:20.755146 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:20.755112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" event={"ID":"69141646-94bf-4f92-94a6-e157b68bb8de","Type":"ContainerStarted","Data":"19a25cc79e326af69ca2159a43d0b336af3e1e8b80b154fff2733411073670e9"} Jun 11 15:05:23.770248 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:23.770171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" event={"ID":"69141646-94bf-4f92-94a6-e157b68bb8de","Type":"ContainerStarted","Data":"32a18927bad5b62222325659ff5797059193692cf7da842e7978fce9704b86d1"} Jun 11 15:05:23.806920 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:23.806868 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8wtsx" podStartSLOduration=1.7774732530000001 podStartE2EDuration="4.806855232s" totalImagesPullingTime="3.029381979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:23.805843939 +0000 UTC m=+386.127145062" watchObservedRunningTime="2026-06-11 15:05:23.806855232 +0000 UTC m=+386.128156356" Jun 11 15:05:24.329841 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:24.329805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:24.419787 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:24.419757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:24.657419 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:24.657388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:25.712621 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:25.712591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:25.937404 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:25.937377 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:31.504050 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:31.504009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:31.653851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:31.653808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:33.160922 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:33.160889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:45.283645 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:45.283605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:45.566288 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:45.566189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:45.914749 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:45.914699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:46.402986 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.402891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:46.606171 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.606138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:46.786090 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.786058 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk"] Jun 11 15:05:46.788535 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.788519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.801228 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.801206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:05:46.801357 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.801289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:05:46.801600 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.801583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:05:46.801745 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.801711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5czj\"" Jun 11 15:05:46.803030 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.803013 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:05:46.860183 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.860144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.860369 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.860221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.860369 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.860308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fnq\" (UniqueName: \"kubernetes.io/projected/3f34650c-3382-449b-bc90-b3404a755a3e-kube-api-access-g9fnq\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.860478 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.860378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-manifests\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.860478 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.860440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-tmp\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.864327 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.864302 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk"] Jun 11 15:05:46.960949 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.960911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-tmp\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.961114 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.960974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.961114 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.961017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.961114 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.961050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fnq\" (UniqueName: \"kubernetes.io/projected/3f34650c-3382-449b-bc90-b3404a755a3e-kube-api-access-g9fnq\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.961284 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.961113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-manifests\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.961438 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.961417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-manifests\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.963985 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.963963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f34650c-3382-449b-bc90-b3404a755a3e-tmp\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.964085 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.964034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.964186 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.964168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f34650c-3382-449b-bc90-b3404a755a3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:46.993911 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:46.993890 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fnq\" (UniqueName: \"kubernetes.io/projected/3f34650c-3382-449b-bc90-b3404a755a3e-kube-api-access-g9fnq\") pod \"opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk\" (UID: \"3f34650c-3382-449b-bc90-b3404a755a3e\") " pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:47.098793 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.098694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:47.303982 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.303960 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk"] Jun 11 15:05:47.306435 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:05:47.306403 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f34650c_3382_449b_bc90_b3404a755a3e.slice/crio-5fce0cee3b2160c26746e1370fb60ab9de328019407973321998184edc1add01 WatchSource:0}: Error finding container 5fce0cee3b2160c26746e1370fb60ab9de328019407973321998184edc1add01: Status 404 returned error can't find the container with id 5fce0cee3b2160c26746e1370fb60ab9de328019407973321998184edc1add01 Jun 11 15:05:47.392505 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.392427 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:47.539743 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.539682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:47.634860 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.634821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:47.745595 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.745528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:47.848365 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.848323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:47.865639 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.865594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" event={"ID":"3f34650c-3382-449b-bc90-b3404a755a3e","Type":"ContainerStarted","Data":"5fce0cee3b2160c26746e1370fb60ab9de328019407973321998184edc1add01"} Jun 11 15:05:47.962478 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:47.962385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:05:50.879325 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:50.879291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" event={"ID":"3f34650c-3382-449b-bc90-b3404a755a3e","Type":"ContainerStarted","Data":"fee9cbf53193272c27e4dc6be81df7c49b8e2b1268843864de94e4aa26610ab2"} Jun 11 15:05:51.885148 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:51.885115 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f34650c-3382-449b-bc90-b3404a755a3e" containerID="fee9cbf53193272c27e4dc6be81df7c49b8e2b1268843864de94e4aa26610ab2" exitCode=0 Jun 11 15:05:51.885503 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:51.885186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" event={"ID":"3f34650c-3382-449b-bc90-b3404a755a3e","Type":"ContainerDied","Data":"fee9cbf53193272c27e4dc6be81df7c49b8e2b1268843864de94e4aa26610ab2"} Jun 11 15:05:52.892097 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:52.892063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" event={"ID":"3f34650c-3382-449b-bc90-b3404a755a3e","Type":"ContainerStarted","Data":"114786d371d3f87a343c5e75d15b3ba491d1e564aee64f99d362ebfcf06b3e1e"} Jun 11 15:05:52.892498 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:52.892202 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:05:52.996851 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:05:52.996803 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" podStartSLOduration=2.28462244 podStartE2EDuration="6.996786413s" totalImagesPullingTime="3.744651463s" totalInitContainerRuntime="967.51251ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:52.995462813 +0000 UTC m=+415.316763951" watchObservedRunningTime="2026-06-11 15:05:52.996786413 +0000 UTC m=+415.318087536" Jun 11 15:06:03.898475 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:03.898439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk" Jun 11 15:06:06.429073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.428989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:06.572938 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.572909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:06.743222 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.743161 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh"] Jun 11 15:06:06.746400 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.746386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.757019 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.757001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:06:06.758642 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.758624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:06:06.758765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.758624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8788p\"" Jun 11 15:06:06.758765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.758628 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:06:06.758765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.758735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:06:06.760411 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.760398 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:06:06.775455 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.775436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh"] Jun 11 15:06:06.817833 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.817811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-metrics-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.817974 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.817906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v77w\" (UniqueName: \"kubernetes.io/projected/dbcf02bb-0f40-43bd-966e-645e0364d0bb-kube-api-access-8v77w\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.817974 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.817949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.818085 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.818016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbcf02bb-0f40-43bd-966e-645e0364d0bb-manager-config\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.918598 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.918574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbcf02bb-0f40-43bd-966e-645e0364d0bb-manager-config\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.918708 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.918605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-metrics-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.918708 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.918642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v77w\" (UniqueName: \"kubernetes.io/projected/dbcf02bb-0f40-43bd-966e-645e0364d0bb-kube-api-access-8v77w\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.918708 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.918666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.919243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.919223 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dbcf02bb-0f40-43bd-966e-645e0364d0bb-manager-config\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.921137 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.921119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-metrics-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.921235 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.921173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbcf02bb-0f40-43bd-966e-645e0364d0bb-cert\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:06.978960 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:06.978938 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v77w\" (UniqueName: \"kubernetes.io/projected/dbcf02bb-0f40-43bd-966e-645e0364d0bb-kube-api-access-8v77w\") pod \"lws-controller-manager-5f7555c9dd-ndlvh\" (UID: \"dbcf02bb-0f40-43bd-966e-645e0364d0bb\") " pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:07.055614 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:07.055557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:07.543310 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:06:07.543280 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcf02bb_0f40_43bd_966e_645e0364d0bb.slice/crio-1b456687ce763533830f49c5a06120d6623ba2fd54588c603943df3de31b8dc1 WatchSource:0}: Error finding container 1b456687ce763533830f49c5a06120d6623ba2fd54588c603943df3de31b8dc1: Status 404 returned error can't find the container with id 1b456687ce763533830f49c5a06120d6623ba2fd54588c603943df3de31b8dc1 Jun 11 15:06:07.553229 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:07.553207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh"] Jun 11 15:06:07.958989 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:07.958954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" event={"ID":"dbcf02bb-0f40-43bd-966e-645e0364d0bb","Type":"ContainerStarted","Data":"1b456687ce763533830f49c5a06120d6623ba2fd54588c603943df3de31b8dc1"} Jun 11 15:06:08.562784 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:08.562748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:08.825944 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:08.825761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:10.604241 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:10.604213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:10.976260 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:10.976223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" event={"ID":"dbcf02bb-0f40-43bd-966e-645e0364d0bb","Type":"ContainerStarted","Data":"c06eadbd8ad098f579dce40136708048cc94ede3a7b4ecc62ac2dd0f9ed7c118"} Jun 11 15:06:10.976434 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:10.976354 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:10.988165 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:10.988128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:11.205276 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.205227 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" podStartSLOduration=2.221418891 podStartE2EDuration="5.205212005s" totalImagesPullingTime="2.983793114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:11.205088081 +0000 UTC m=+433.526389204" watchObservedRunningTime="2026-06-11 15:06:11.205212005 +0000 UTC m=+433.526513129" Jun 11 15:06:11.274513 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.274420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:11.499785 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.499753 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n"] Jun 11 15:06:11.510506 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.510476 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.517577 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:06:11.517538 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Jun 11 15:06:11.517680 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:06:11.517573 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-6559bc885d-pjh4n\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="1f734157-5f71-4d29-8761-b6fb89732183" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.518302 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.518283 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:06:11.518515 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:06:11.518496 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 11 15:06:11.519491 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.519473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cqbh7\"" Jun 11 15:06:11.521561 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.521542 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 15:06:11.591324 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.591240 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n"] Jun 11 15:06:11.611194 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.611154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:11.664491 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.664452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f734157-5f71-4d29-8761-b6fb89732183-tls-certs\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.664491 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.664493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f734157-5f71-4d29-8761-b6fb89732183-tmp\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.664703 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.664565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glb2x\" (UniqueName: \"kubernetes.io/projected/1f734157-5f71-4d29-8761-b6fb89732183-kube-api-access-glb2x\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.765456 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.765424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f734157-5f71-4d29-8761-b6fb89732183-tls-certs\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.765456 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.765463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f734157-5f71-4d29-8761-b6fb89732183-tmp\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.765648 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.765509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glb2x\" (UniqueName: \"kubernetes.io/projected/1f734157-5f71-4d29-8761-b6fb89732183-kube-api-access-glb2x\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.768021 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.767988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f734157-5f71-4d29-8761-b6fb89732183-tmp\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.768219 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.768198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f734157-5f71-4d29-8761-b6fb89732183-tls-certs\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:11.817855 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:11.817798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:12.706422 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:12.706391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:06:12.713368 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:12.713337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 15:06:12.714986 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:12.714965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glb2x\" (UniqueName: \"kubernetes.io/projected/1f734157-5f71-4d29-8761-b6fb89732183-kube-api-access-glb2x\") pod \"kube-auth-proxy-6559bc885d-pjh4n\" (UID: \"1f734157-5f71-4d29-8761-b6fb89732183\") " pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:12.720823 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:12.720802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" Jun 11 15:06:13.040072 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:13.039990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n"] Jun 11 15:06:13.044678 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:06:13.044641 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f734157_5f71_4d29_8761_b6fb89732183.slice/crio-9d76a771a5c907720101a3e4e798c0a4acb807fc03f1d372cb9b5dee9b653aa0 WatchSource:0}: Error finding container 9d76a771a5c907720101a3e4e798c0a4acb807fc03f1d372cb9b5dee9b653aa0: Status 404 returned error can't find the container with id 9d76a771a5c907720101a3e4e798c0a4acb807fc03f1d372cb9b5dee9b653aa0 Jun 11 15:06:13.674124 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:13.674070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:13.992904 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:13.992811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" event={"ID":"1f734157-5f71-4d29-8761-b6fb89732183","Type":"ContainerStarted","Data":"9d76a771a5c907720101a3e4e798c0a4acb807fc03f1d372cb9b5dee9b653aa0"} Jun 11 15:06:14.116258 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:14.116213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:17.006971 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:17.006936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" event={"ID":"1f734157-5f71-4d29-8761-b6fb89732183","Type":"ContainerStarted","Data":"25108e36f9a47b16cd519c550e329a4abfc62e295bdab161451a29d2cc021bc6"} Jun 11 15:06:17.064765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:17.064631 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6559bc885d-pjh4n" podStartSLOduration=2.318945547 podStartE2EDuration="6.064609492s" totalImagesPullingTime="3.745663945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:17.063327825 +0000 UTC m=+439.384628951" watchObservedRunningTime="2026-06-11 15:06:17.064609492 +0000 UTC m=+439.385910616" Jun 11 15:06:21.982422 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:21.982385 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f7555c9dd-ndlvh" Jun 11 15:06:24.222004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:24.221968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:24.429203 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:24.429165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:24.944211 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:24.944167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:25.109063 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:25.109028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:25.300748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:25.300641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:25.534052 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:25.534017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:25.826358 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:25.826323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:26.708164 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:26.708128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:26.946844 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:26.946813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:27.049988 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:27.049896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:27.261172 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:27.261136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:27.391152 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:27.391064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:27.580744 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:27.580698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:27.962620 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:27.962582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:28.181648 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:28.181609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:39.024132 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:39.024080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:39.141869 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:39.141812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:41.503146 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:41.503114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:59.228441 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:59.228407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:59.349713 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:59.349677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:59.828156 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:06:59.828112 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:00.840850 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:00.840813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.118056 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.118014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.218207 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.218164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.411544 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.411502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.621045 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.621001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.807396 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.807304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:04.881298 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:04.881257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:05.153753 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:05.153645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:10.163249 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:10.163189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:10.271864 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:10.271832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:10.393235 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:10.393204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:10.653004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:10.652926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:10.795992 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:10.795963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:15.769484 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:15.769445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:15.869894 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:15.869862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:15.938578 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:15.938551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:17.572252 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:17.572214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:33.554790 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:33.554717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:36.941531 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:36.941500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:41.739098 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:41.739052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:45.321540 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:45.321504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:50.583077 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.583041 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf"] Jun 11 15:07:50.585282 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.585266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.588355 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.588334 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2cm2t\"" Jun 11 15:07:50.588923 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.588909 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:07:50.589133 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.589114 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:07:50.601206 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.601183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf"] Jun 11 15:07:50.702876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.702841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkgj\" (UniqueName: \"kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.702876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.702876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.804335 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.804294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkgj\" (UniqueName: \"kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.804335 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.804333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.804683 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.804667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.829397 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.829364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkgj\" (UniqueName: \"kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.895214 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.895130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:50.925592 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:50.925557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:51.039763 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:51.039716 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf"] Jun 11 15:07:51.043016 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:07:51.042990 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf181c1da_4a1a_45a4_b4c4_c93901e9e181.slice/crio-d35d5fd9c3693ffa2cb80fdec24a05332065a724da0f40ec315708d63a5c349f WatchSource:0}: Error finding container d35d5fd9c3693ffa2cb80fdec24a05332065a724da0f40ec315708d63a5c349f: Status 404 returned error can't find the container with id d35d5fd9c3693ffa2cb80fdec24a05332065a724da0f40ec315708d63a5c349f Jun 11 15:07:51.418793 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:51.418756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" event={"ID":"f181c1da-4a1a-45a4-b4c4-c93901e9e181","Type":"ContainerStarted","Data":"d35d5fd9c3693ffa2cb80fdec24a05332065a724da0f40ec315708d63a5c349f"} Jun 11 15:07:51.735125 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:51.735045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:59.457419 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:59.457384 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" event={"ID":"f181c1da-4a1a-45a4-b4c4-c93901e9e181","Type":"ContainerStarted","Data":"fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2"} Jun 11 15:07:59.457816 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:59.457510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:07:59.486383 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:07:59.486334 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" podStartSLOduration=1.758324031 podStartE2EDuration="9.486322087s" totalImagesPullingTime="7.727998056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:59.485314961 +0000 UTC m=+541.806616083" watchObservedRunningTime="2026-06-11 15:07:59.486322087 +0000 UTC m=+541.807623211" Jun 11 15:08:01.578973 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:01.578943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:01.742459 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:01.742421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:03.184960 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:03.184931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:03.267186 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:03.267143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:03.382095 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:03.382055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:03.475568 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:03.475469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:04.632854 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:04.632815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:05.852124 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:05.852081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:06.155671 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:06.155640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:06.256046 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:06.256018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:07.043620 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:07.043589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:10.464033 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:10.464004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:11.536528 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.536501 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh"] Jun 11 15:08:11.538629 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.538613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.550937 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.550918 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh"] Jun 11 15:08:11.678300 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.678277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.678409 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.678312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5pr4\" (UniqueName: \"kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.779597 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.779562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.779717 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.779616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5pr4\" (UniqueName: \"kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.779990 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.779968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.791815 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.791760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5pr4\" (UniqueName: \"kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.848660 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.848638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:11.984579 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:11.984549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh"] Jun 11 15:08:11.988407 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:08:11.988379 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197958cd_77e4_4fa0_9b1d_4ebb43b9efc6.slice/crio-8477cba968a4d0b1a475c75453eb6282f47217994737af7bdd27ed85d349d103 WatchSource:0}: Error finding container 8477cba968a4d0b1a475c75453eb6282f47217994737af7bdd27ed85d349d103: Status 404 returned error can't find the container with id 8477cba968a4d0b1a475c75453eb6282f47217994737af7bdd27ed85d349d103 Jun 11 15:08:12.161196 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.161170 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh"] Jun 11 15:08:12.171141 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.171120 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh"] Jun 11 15:08:12.191924 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.191900 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf"] Jun 11 15:08:12.192096 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.192059 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" containerName="manager" containerID="cri-o://fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2" gracePeriod=2 Jun 11 15:08:12.204461 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.204436 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf"] Jun 11 15:08:12.264886 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.264854 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:12.265169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265157 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" containerName="manager" Jun 11 15:08:12.265169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265169 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" containerName="manager" Jun 11 15:08:12.265270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265185 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" containerName="manager" Jun 11 15:08:12.265270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265190 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" containerName="manager" Jun 11 15:08:12.265270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265261 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" containerName="manager" Jun 11 15:08:12.265270 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.265269 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" containerName="manager" Jun 11 15:08:12.267255 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.267236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.300655 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.300597 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:12.323829 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.323795 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.385280 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.385252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.385375 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.385282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpg6\" (UniqueName: \"kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.413393 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.413369 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.416043 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.416022 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.486304 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.486281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.486387 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.486309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpg6\" (UniqueName: \"kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.486703 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.486685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.495273 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.495251 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpg6\" (UniqueName: \"kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qphq9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.512480 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.512460 2581 generic.go:356] "Generic (PLEG): container finished" podID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" containerID="fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2" exitCode=0 Jun 11 15:08:12.512574 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.512500 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.512574 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.512551 2581 scope.go:117] "RemoveContainer" containerID="fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2" Jun 11 15:08:12.514266 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.514249 2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" container="manager" Jun 11 15:08:12.515240 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.515213 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.517568 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.517542 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.519932 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.519905 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:12.521524 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.521504 2581 scope.go:117] "RemoveContainer" containerID="fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2" Jun 11 15:08:12.521765 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.521747 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2\": container with ID starting with fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2 not found: ID does not exist" containerID="fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2" Jun 11 15:08:12.521846 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.521771 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2"} err="failed to get container status \"fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2\": rpc error: code = NotFound desc = could not find container \"fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2\": container with ID starting with fdd03263193bf8c7b99adf99d89338c4387d4302af14acdffa4f2e97e7bb91c2 not found: ID does not exist" Jun 11 15:08:12.577287 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.577239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:12.586637 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.586617 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxkgj\" (UniqueName: \"kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj\") pod \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " Jun 11 15:08:12.586777 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.586660 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume\") pod \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\" (UID: \"f181c1da-4a1a-45a4-b4c4-c93901e9e181\") " Jun 11 15:08:12.587203 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.587182 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f181c1da-4a1a-45a4-b4c4-c93901e9e181" (UID: "f181c1da-4a1a-45a4-b4c4-c93901e9e181"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:12.588735 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.588699 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj" (OuterVolumeSpecName: "kube-api-access-xxkgj") pod "f181c1da-4a1a-45a4-b4c4-c93901e9e181" (UID: "f181c1da-4a1a-45a4-b4c4-c93901e9e181"). InnerVolumeSpecName "kube-api-access-xxkgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:12.687259 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.687227 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxkgj\" (UniqueName: \"kubernetes.io/projected/f181c1da-4a1a-45a4-b4c4-c93901e9e181-kube-api-access-xxkgj\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:12.687259 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.687256 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f181c1da-4a1a-45a4-b4c4-c93901e9e181-extensions-socket-volume\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:12.718548 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:12.718436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:12.720910 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:08:12.720882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10857395_760f_42f0_a6a9_9e8b062d32c9.slice/crio-00f35f517ea06217ff782260f1a13b6a159c3cc30c7926b05e43dbbfad51c405 WatchSource:0}: Error finding container 00f35f517ea06217ff782260f1a13b6a159c3cc30c7926b05e43dbbfad51c405: Status 404 returned error can't find the container with id 00f35f517ea06217ff782260f1a13b6a159c3cc30c7926b05e43dbbfad51c405 Jun 11 15:08:12.826354 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.826320 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:12.828748 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:12.828676 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:13.521009 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.520976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" event={"ID":"10857395-760f-42f0-a6a9-9e8b062d32c9","Type":"ContainerStarted","Data":"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684"} Jun 11 15:08:13.521197 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.521120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:13.521197 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.521174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" event={"ID":"10857395-760f-42f0-a6a9-9e8b062d32c9","Type":"ContainerStarted","Data":"00f35f517ea06217ff782260f1a13b6a159c3cc30c7926b05e43dbbfad51c405"} Jun 11 15:08:13.523442 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.523416 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" containerName="manager" containerID="cri-o://14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4" gracePeriod=2 Jun 11 15:08:13.550862 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.550830 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:13.553318 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.553284 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:13.555932 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.555912 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:13.560636 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.560616 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:13.766876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.766855 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:13.769417 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.769393 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z88lf\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z88lf" Jun 11 15:08:13.771666 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:13.771623 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:13.898271 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.898245 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume\") pod \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " Jun 11 15:08:13.898365 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.898284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5pr4\" (UniqueName: \"kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4\") pod \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\" (UID: \"197958cd-77e4-4fa0-9b1d-4ebb43b9efc6\") " Jun 11 15:08:13.898479 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.898458 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" (UID: "197958cd-77e4-4fa0-9b1d-4ebb43b9efc6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:13.900315 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.900294 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4" (OuterVolumeSpecName: "kube-api-access-t5pr4") pod "197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" (UID: "197958cd-77e4-4fa0-9b1d-4ebb43b9efc6"). InnerVolumeSpecName "kube-api-access-t5pr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:13.998942 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.998890 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-extensions-socket-volume\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:13.998942 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:13.998937 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5pr4\" (UniqueName: \"kubernetes.io/projected/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6-kube-api-access-t5pr4\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:14.149425 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.149353 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" path="/var/lib/kubelet/pods/197958cd-77e4-4fa0-9b1d-4ebb43b9efc6/volumes" Jun 11 15:08:14.149699 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.149686 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f181c1da-4a1a-45a4-b4c4-c93901e9e181" path="/var/lib/kubelet/pods/f181c1da-4a1a-45a4-b4c4-c93901e9e181/volumes" Jun 11 15:08:14.529464 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.529427 2581 generic.go:356] "Generic (PLEG): container finished" podID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" containerID="14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4" exitCode=2 Jun 11 15:08:14.529641 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.529476 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:14.529641 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.529495 2581 scope.go:117] "RemoveContainer" containerID="14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4" Jun 11 15:08:14.534525 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:14.534500 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k6plh\" is forbidden: User \"system:node:ip-10-0-128-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-43.ec2.internal' and this object" podUID="197958cd-77e4-4fa0-9b1d-4ebb43b9efc6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6plh" Jun 11 15:08:14.537706 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.537678 2581 scope.go:117] "RemoveContainer" containerID="14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4" Jun 11 15:08:14.537988 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:14.537962 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4\": container with ID starting with 14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4 not found: ID does not exist" containerID="14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4" Jun 11 15:08:14.538054 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.537988 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4"} err="failed to get container status \"14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4\": rpc error: code = NotFound desc = could not find container \"14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4\": container with ID starting with 14c0e8f9ce53694d37255ebd324d836435658d2f81a9bd4f9a57190fcd55fda4 not found: ID does not exist" Jun 11 15:08:14.544525 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.544500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:14.640674 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.640640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:14.951967 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:14.951934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:15.052509 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:15.052480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:19.328702 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:19.328671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:19.429801 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:19.429769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:22.924248 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:22.924206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:23.043460 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:23.043429 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:24.532132 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:24.532100 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:24.560249 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:24.560207 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" podStartSLOduration=12.560193039 podStartE2EDuration="12.560193039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:13.548223499 +0000 UTC m=+555.869524620" watchObservedRunningTime="2026-06-11 15:08:24.560193039 +0000 UTC m=+566.881494160" Jun 11 15:08:25.732907 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:25.732867 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:25.828288 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:25.828247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:34.556886 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:34.556844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:34.657943 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:34.657901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:34.758656 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:34.758620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:37.196378 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:37.196332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:37.592717 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:37.592631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:40.417459 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:40.417422 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:40.533254 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:40.533223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:41.019889 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.019853 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:41.020073 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.020049 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" podUID="10857395-760f-42f0-a6a9-9e8b062d32c9" containerName="manager" containerID="cri-o://ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684" gracePeriod=10 Jun 11 15:08:41.253200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.253176 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd"] Jun 11 15:08:41.255547 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.255531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.265568 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.265549 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:41.268749 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.268705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd"] Jun 11 15:08:41.309511 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309448 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume\") pod \"10857395-760f-42f0-a6a9-9e8b062d32c9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " Jun 11 15:08:41.309642 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbpg6\" (UniqueName: \"kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6\") pod \"10857395-760f-42f0-a6a9-9e8b062d32c9\" (UID: \"10857395-760f-42f0-a6a9-9e8b062d32c9\") " Jun 11 15:08:41.309774 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.309893 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhk4n\" (UniqueName: \"kubernetes.io/projected/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-kube-api-access-qhk4n\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.309946 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309917 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10857395-760f-42f0-a6a9-9e8b062d32c9" (UID: "10857395-760f-42f0-a6a9-9e8b062d32c9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:41.310004 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.309961 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10857395-760f-42f0-a6a9-9e8b062d32c9-extensions-socket-volume\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:41.312351 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.312309 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6" (OuterVolumeSpecName: "kube-api-access-gbpg6") pod "10857395-760f-42f0-a6a9-9e8b062d32c9" (UID: "10857395-760f-42f0-a6a9-9e8b062d32c9"). InnerVolumeSpecName "kube-api-access-gbpg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:41.411266 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.411243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.411384 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.411300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhk4n\" (UniqueName: \"kubernetes.io/projected/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-kube-api-access-qhk4n\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.411384 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.411362 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbpg6\" (UniqueName: \"kubernetes.io/projected/10857395-760f-42f0-a6a9-9e8b062d32c9-kube-api-access-gbpg6\") on node \"ip-10-0-128-43.ec2.internal\" DevicePath \"\"" Jun 11 15:08:41.411610 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.411589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.421299 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.421279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhk4n\" (UniqueName: \"kubernetes.io/projected/d42381f6-4e2c-4fe0-b919-e9dbb510fc39-kube-api-access-qhk4n\") pod \"kuadrant-operator-controller-manager-86878c769f-5l8fd\" (UID: \"d42381f6-4e2c-4fe0-b919-e9dbb510fc39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.574142 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.574058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:41.649830 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.649798 2581 generic.go:356] "Generic (PLEG): container finished" podID="10857395-760f-42f0-a6a9-9e8b062d32c9" containerID="ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684" exitCode=0 Jun 11 15:08:41.650002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.649859 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" Jun 11 15:08:41.650002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.649892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" event={"ID":"10857395-760f-42f0-a6a9-9e8b062d32c9","Type":"ContainerDied","Data":"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684"} Jun 11 15:08:41.650002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.649965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9" event={"ID":"10857395-760f-42f0-a6a9-9e8b062d32c9","Type":"ContainerDied","Data":"00f35f517ea06217ff782260f1a13b6a159c3cc30c7926b05e43dbbfad51c405"} Jun 11 15:08:41.650002 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.649986 2581 scope.go:117] "RemoveContainer" containerID="ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684" Jun 11 15:08:41.660419 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.660394 2581 scope.go:117] "RemoveContainer" containerID="ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684" Jun 11 15:08:41.660759 ip-10-0-128-43 kubenswrapper[2581]: E0611 15:08:41.660733 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684\": container with ID starting with ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684 not found: ID does not exist" containerID="ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684" Jun 11 15:08:41.660856 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.660767 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684"} err="failed to get container status \"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684\": rpc error: code = NotFound desc = could not find container \"ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684\": container with ID starting with ee4d860da24dbeea6e227c351dda593c5c58528b21dbd8856cb4252b79209684 not found: ID does not exist" Jun 11 15:08:41.676999 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.676054 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:41.678516 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.678491 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qphq9"] Jun 11 15:08:41.708322 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:41.708294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd"] Jun 11 15:08:41.712337 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:08:41.712311 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42381f6_4e2c_4fe0_b919_e9dbb510fc39.slice/crio-a3d92994b7963b312e034de16d371fb8bdf65e84d46206a2d0dffe7341b16e81 WatchSource:0}: Error finding container a3d92994b7963b312e034de16d371fb8bdf65e84d46206a2d0dffe7341b16e81: Status 404 returned error can't find the container with id a3d92994b7963b312e034de16d371fb8bdf65e84d46206a2d0dffe7341b16e81 Jun 11 15:08:42.150140 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:42.150104 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10857395-760f-42f0-a6a9-9e8b062d32c9" path="/var/lib/kubelet/pods/10857395-760f-42f0-a6a9-9e8b062d32c9/volumes" Jun 11 15:08:42.655454 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:42.655394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" event={"ID":"d42381f6-4e2c-4fe0-b919-e9dbb510fc39","Type":"ContainerStarted","Data":"2938100d0648b9f75d2b89733639bab89a2561781d979d4464b0c4b2c4056dd2"} Jun 11 15:08:42.655926 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:42.655467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" event={"ID":"d42381f6-4e2c-4fe0-b919-e9dbb510fc39","Type":"ContainerStarted","Data":"a3d92994b7963b312e034de16d371fb8bdf65e84d46206a2d0dffe7341b16e81"} Jun 11 15:08:42.655926 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:42.655566 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:42.679425 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:42.679379 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" podStartSLOduration=1.6793641959999999 podStartE2EDuration="1.679364196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:42.67802953 +0000 UTC m=+584.999330653" watchObservedRunningTime="2026-06-11 15:08:42.679364196 +0000 UTC m=+585.000665383" Jun 11 15:08:43.964798 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:43.964755 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:44.064519 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:44.064486 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:53.174191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:53.174147 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:53.274218 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:53.274184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:53.663840 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:53.663808 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5l8fd" Jun 11 15:08:57.383208 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:57.383171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:57.955479 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:57.955432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:08:58.136127 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:58.136097 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:08:58.139303 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:08:58.139279 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:09:00.880047 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:00.880004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:00.984716 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:00.984682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:01.056579 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.056534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:01.266661 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.266627 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:09:01.267114 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.267094 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10857395-760f-42f0-a6a9-9e8b062d32c9" containerName="manager" Jun 11 15:09:01.267197 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.267118 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10857395-760f-42f0-a6a9-9e8b062d32c9" containerName="manager" Jun 11 15:09:01.267235 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.267209 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="10857395-760f-42f0-a6a9-9e8b062d32c9" containerName="manager" Jun 11 15:09:01.270425 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.270407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.273430 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.273408 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 15:09:01.273430 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.273422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hdp2v\"" Jun 11 15:09:01.278357 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.278337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:09:01.290219 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.290196 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:09:01.394936 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.394898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8gt\" (UniqueName: \"kubernetes.io/projected/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-kube-api-access-8d8gt\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.395108 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.394944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-config-file\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.496305 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.496272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8gt\" (UniqueName: \"kubernetes.io/projected/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-kube-api-access-8d8gt\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.496516 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.496311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-config-file\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.496976 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.496958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-config-file\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.505977 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.505954 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8gt\" (UniqueName: \"kubernetes.io/projected/24c1ac90-aab6-4539-9ee1-43bfd6d0ce42-kube-api-access-8d8gt\") pod \"limitador-limitador-54d6d988d5-n9q54\" (UID: \"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.581194 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.581120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:01.716102 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.716079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:09:01.718429 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:09:01.718395 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c1ac90_aab6_4539_9ee1_43bfd6d0ce42.slice/crio-236a33aff2d54b7535f084b6b5f80fe48682fc95fa70828602f2eee6aba3f9c7 WatchSource:0}: Error finding container 236a33aff2d54b7535f084b6b5f80fe48682fc95fa70828602f2eee6aba3f9c7: Status 404 returned error can't find the container with id 236a33aff2d54b7535f084b6b5f80fe48682fc95fa70828602f2eee6aba3f9c7 Jun 11 15:09:01.739269 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.739240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:01.749765 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.749741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" event={"ID":"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42","Type":"ContainerStarted","Data":"236a33aff2d54b7535f084b6b5f80fe48682fc95fa70828602f2eee6aba3f9c7"} Jun 11 15:09:01.881208 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:01.881125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:04.766954 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:04.766917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" event={"ID":"24c1ac90-aab6-4539-9ee1-43bfd6d0ce42","Type":"ContainerStarted","Data":"d64bda2dffc5d00dad9a203e28f3f59fb32292c8254f2f343d5172c617bbeae7"} Jun 11 15:09:04.767447 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:04.767079 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:04.786174 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:04.786131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" podStartSLOduration=1.390324458 podStartE2EDuration="3.786117836s" totalImagesPullingTime="2.395793378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:04.785472144 +0000 UTC m=+607.106773289" watchObservedRunningTime="2026-06-11 15:09:04.786117836 +0000 UTC m=+607.107418959" Jun 11 15:09:15.772519 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:15.772491 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9q54" Jun 11 15:09:20.375298 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:20.375266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:30.143374 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:30.143335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:30.244214 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:30.244187 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:30.376899 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:30.376865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:55.521295 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:55.521232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:55.621406 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:09:55.621373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:17.216849 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:17.216809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:25.017888 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:25.017848 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:25.241814 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:25.241773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:30.307824 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:30.307781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:30.405378 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:30.405344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:30.477790 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:30.477762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:33.644633 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:33.644595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:33.755929 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:10:33.755889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:11:04.739686 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:04.739649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:11:04.841108 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:04.841065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:11:05.207216 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.207171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:11:05.307555 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.307506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:11:05.419362 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.419330 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8sgzx"] Jun 11 15:11:05.422101 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.422085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:05.425832 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.425800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7h2jg\"" Jun 11 15:11:05.426121 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.426102 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 15:11:05.437913 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.437889 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8sgzx"] Jun 11 15:11:05.440258 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.440230 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:11:05.515105 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.515025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdbp\" (UniqueName: \"kubernetes.io/projected/8a3a2e68-cf13-474a-8d8d-9343d6296377-kube-api-access-8mdbp\") pod \"payload-pre-processing-579785bc64-8sgzx\" (UID: \"8a3a2e68-cf13-474a-8d8d-9343d6296377\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:05.615908 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.615877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdbp\" (UniqueName: \"kubernetes.io/projected/8a3a2e68-cf13-474a-8d8d-9343d6296377-kube-api-access-8mdbp\") pod \"payload-pre-processing-579785bc64-8sgzx\" (UID: \"8a3a2e68-cf13-474a-8d8d-9343d6296377\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:05.628867 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.628838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdbp\" (UniqueName: \"kubernetes.io/projected/8a3a2e68-cf13-474a-8d8d-9343d6296377-kube-api-access-8mdbp\") pod \"payload-pre-processing-579785bc64-8sgzx\" (UID: \"8a3a2e68-cf13-474a-8d8d-9343d6296377\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:05.732843 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.732812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:05.865577 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.865554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8sgzx"] Jun 11 15:11:05.867790 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:11:05.867759 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3a2e68_cf13_474a_8d8d_9343d6296377.slice/crio-f418af042afc8cb7b389e5e677e3575d432a181ae1f4b6aced000a7e71daabe1 WatchSource:0}: Error finding container f418af042afc8cb7b389e5e677e3575d432a181ae1f4b6aced000a7e71daabe1: Status 404 returned error can't find the container with id f418af042afc8cb7b389e5e677e3575d432a181ae1f4b6aced000a7e71daabe1 Jun 11 15:11:05.869607 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:05.869583 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:11:06.309193 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:06.309162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" event={"ID":"8a3a2e68-cf13-474a-8d8d-9343d6296377","Type":"ContainerStarted","Data":"f418af042afc8cb7b389e5e677e3575d432a181ae1f4b6aced000a7e71daabe1"} Jun 11 15:11:08.327037 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:08.327004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" event={"ID":"8a3a2e68-cf13-474a-8d8d-9343d6296377","Type":"ContainerStarted","Data":"e1158e999c6e0045f1d5593bb61a095b912ff34b9dac56e5b1dc0bfae351a77e"} Jun 11 15:11:08.327490 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:08.327120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:11:08.351495 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:08.351443 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" podStartSLOduration=1.142347596 podStartE2EDuration="3.351430404s" totalImagesPullingTime="2.209082808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:08.349184983 +0000 UTC m=+730.670486105" watchObservedRunningTime="2026-06-11 15:11:08.351430404 +0000 UTC m=+730.672731526" Jun 11 15:11:19.335027 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:11:19.334996 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8sgzx" Jun 11 15:12:18.666034 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:12:18.665946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:12:25.809348 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:12:25.809310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:12:51.647867 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:12:51.647826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:13:57.432623 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:13:57.432587 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:13:57.526404 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:13:57.526367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:13:58.172707 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:13:58.172678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:13:58.176936 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:13:58.176913 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:14:08.671080 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:08.671044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:08.803162 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:08.803128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:13.384352 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:13.384313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:13.780616 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:13.780574 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:14:22.319538 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.319499 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp"] Jun 11 15:14:22.322229 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.322211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.326195 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.326168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:14:22.327789 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.327763 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:14:22.327935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.327770 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 15:14:22.327935 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.327847 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4rhpz\"" Jun 11 15:14:22.335839 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.335819 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp"] Jun 11 15:14:22.364924 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.364881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:22.416826 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.416801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.416947 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.416858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gtwt\" (UniqueName: \"kubernetes.io/projected/f5b77905-4364-4ced-9124-6126b9bca03b-kube-api-access-8gtwt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.416947 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.416879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5b77905-4364-4ced-9124-6126b9bca03b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.417017 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.416975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.417017 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.416998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.417083 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.417018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518243 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gtwt\" (UniqueName: \"kubernetes.io/projected/f5b77905-4364-4ced-9124-6126b9bca03b-kube-api-access-8gtwt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518370 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5b77905-4364-4ced-9124-6126b9bca03b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518370 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518370 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518532 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518532 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518679 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518835 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518813 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.518907 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.518838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.520760 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.520716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5b77905-4364-4ced-9124-6126b9bca03b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.521027 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.521009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5b77905-4364-4ced-9124-6126b9bca03b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.526565 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.526544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gtwt\" (UniqueName: \"kubernetes.io/projected/f5b77905-4364-4ced-9124-6126b9bca03b-kube-api-access-8gtwt\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hzrbp\" (UID: \"f5b77905-4364-4ced-9124-6126b9bca03b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.633398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.633342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:22.767469 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.767445 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp"] Jun 11 15:14:22.770062 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:14:22.770035 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b77905_4364_4ced_9124_6126b9bca03b.slice/crio-b2733a750da1d1b73dba16265bb7c94e0768518fbc96e86a7f824cb0af37a744 WatchSource:0}: Error finding container b2733a750da1d1b73dba16265bb7c94e0768518fbc96e86a7f824cb0af37a744: Status 404 returned error can't find the container with id b2733a750da1d1b73dba16265bb7c94e0768518fbc96e86a7f824cb0af37a744 Jun 11 15:14:22.879184 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:22.879154 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:14:23.229740 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:23.229685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" event={"ID":"f5b77905-4364-4ced-9124-6126b9bca03b","Type":"ContainerStarted","Data":"b2733a750da1d1b73dba16265bb7c94e0768518fbc96e86a7f824cb0af37a744"} Jun 11 15:14:26.245967 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:26.245924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" event={"ID":"f5b77905-4364-4ced-9124-6126b9bca03b","Type":"ContainerStarted","Data":"603326a15e2027f6e9a34f2ae63fecf30d20290d0440d733808c44596bd6cab9"} Jun 11 15:14:30.264504 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:30.264467 2581 generic.go:356] "Generic (PLEG): container finished" podID="f5b77905-4364-4ced-9124-6126b9bca03b" containerID="603326a15e2027f6e9a34f2ae63fecf30d20290d0440d733808c44596bd6cab9" exitCode=0 Jun 11 15:14:30.264890 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:30.264540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" event={"ID":"f5b77905-4364-4ced-9124-6126b9bca03b","Type":"ContainerDied","Data":"603326a15e2027f6e9a34f2ae63fecf30d20290d0440d733808c44596bd6cab9"} Jun 11 15:14:30.688674 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:30.688632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:31.567916 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:31.567883 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:14:32.275822 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:32.275789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" event={"ID":"f5b77905-4364-4ced-9124-6126b9bca03b","Type":"ContainerStarted","Data":"27a9ac34dc4d1a38835578fb0a988a7bbb0112df6e19bf061ef6392e3ceb7868"} Jun 11 15:14:32.296046 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:32.296000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" podStartSLOduration=2.649066715 podStartE2EDuration="10.295981711s" totalImagesPullingTime="4.493612241s" totalInitContainerRuntime="3.153302755s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:14:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:14:32.294197459 +0000 UTC m=+934.615498581" watchObservedRunningTime="2026-06-11 15:14:32.295981711 +0000 UTC m=+934.617282814" Jun 11 15:14:32.634592 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:32.634503 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:32.634592 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:32.634563 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:32.647418 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:32.647394 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:33.291859 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:33.291829 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hzrbp" Jun 11 15:14:37.928926 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:37.928897 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l"] Jun 11 15:14:37.931564 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:37.931545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:37.934494 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:37.934476 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 15:14:37.942278 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:37.942257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l"] Jun 11 15:14:38.008026 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.008003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:38.055070 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn7l2\" (UniqueName: \"kubernetes.io/projected/588fc635-2921-4e5a-a6ae-363540b81e1f-kube-api-access-pn7l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.055169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588fc635-2921-4e5a-a6ae-363540b81e1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.055169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.055169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.055169 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.055305 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.055239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156302 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn7l2\" (UniqueName: \"kubernetes.io/projected/588fc635-2921-4e5a-a6ae-363540b81e1f-kube-api-access-pn7l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156398 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588fc635-2921-4e5a-a6ae-363540b81e1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156501 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156827 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156798 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.156940 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156898 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.157007 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.156941 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.158706 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.158688 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/588fc635-2921-4e5a-a6ae-363540b81e1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.159005 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.158987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588fc635-2921-4e5a-a6ae-363540b81e1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.165052 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.165034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn7l2\" (UniqueName: \"kubernetes.io/projected/588fc635-2921-4e5a-a6ae-363540b81e1f-kube-api-access-pn7l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l\" (UID: \"588fc635-2921-4e5a-a6ae-363540b81e1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.242602 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.242549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" Jun 11 15:14:38.376030 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.376003 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l"] Jun 11 15:14:38.378690 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:14:38.378656 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588fc635_2921_4e5a_a6ae_363540b81e1f.slice/crio-72467f72c90334df85576ea8a70bfcfc204d69405a829fea61abb4b06797f8af WatchSource:0}: Error finding container 72467f72c90334df85576ea8a70bfcfc204d69405a829fea61abb4b06797f8af: Status 404 returned error can't find the container with id 72467f72c90334df85576ea8a70bfcfc204d69405a829fea61abb4b06797f8af Jun 11 15:14:38.871544 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:38.871505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:14:39.313267 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:39.313231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" event={"ID":"588fc635-2921-4e5a-a6ae-363540b81e1f","Type":"ContainerStarted","Data":"68ac2f9079d06b4a9b31abc35124b2f0763764e8b65dc70bca1375be296b05ea"} Jun 11 15:14:39.313710 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:39.313293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l" event={"ID":"588fc635-2921-4e5a-a6ae-363540b81e1f","Type":"ContainerStarted","Data":"72467f72c90334df85576ea8a70bfcfc204d69405a829fea61abb4b06797f8af"} Jun 11 15:14:45.712400 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:45.712363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:46.566871 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:46.566833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:14:51.571554 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:51.571513 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:14:52.676548 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:14:52.676515 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9q54"] Jun 11 15:15:56.214191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:15:56.214132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:16:57.830796 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:16:57.830749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:18:58.204127 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:18:58.204100 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:18:58.209444 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:18:58.209423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ckdt2_499faf90-991f-49e8-8a30-000f847b13db/ovn-acl-logging/0.log" Jun 11 15:20:49.267897 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:20:49.267851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:01.007041 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:01.007013 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l_588fc635-2921-4e5a-a6ae-363540b81e1f/storage-initializer/0.log" Jun 11 15:21:08.044850 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:08.044771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk_3f34650c-3382-449b-bc90-b3404a755a3e/copy-manifests/0.log" Jun 11 15:21:08.059409 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:08.059371 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk_3f34650c-3382-449b-bc90-b3404a755a3e/manager/0.log" Jun 11 15:21:09.995880 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:09.995824 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5l8fd_d42381f6-4e2c-4fe0-b919-e9dbb510fc39/manager/0.log" Jun 11 15:21:10.105458 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:10.105428 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n9q54_24c1ac90-aab6-4539-9ee1-43bfd6d0ce42/limitador/0.log" Jun 11 15:21:10.835709 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:10.835679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6559bc885d-pjh4n_1f734157-5f71-4d29-8761-b6fb89732183/kube-auth-proxy/0.log" Jun 11 15:21:11.198202 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:11.198166 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8sgzx_8a3a2e68-cf13-474a-8d8d-9343d6296377/payload-pre-processing/0.log" Jun 11 15:21:11.887503 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:11.887467 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hzrbp_f5b77905-4364-4ced-9124-6126b9bca03b/storage-initializer/0.log" Jun 11 15:21:11.893709 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:11.893677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hzrbp_f5b77905-4364-4ced-9124-6126b9bca03b/main/0.log" Jun 11 15:21:12.126092 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:12.126063 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg864l_588fc635-2921-4e5a-a6ae-363540b81e1f/storage-initializer/0.log" Jun 11 15:21:16.668267 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.668232 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cm9qx/must-gather-2dhx9"] Jun 11 15:21:16.671829 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.671809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.675200 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.675176 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cm9qx\"/\"openshift-service-ca.crt\"" Jun 11 15:21:16.675342 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.675227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cm9qx\"/\"default-dockercfg-wv8hg\"" Jun 11 15:21:16.676392 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.676355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:16.676802 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.676787 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cm9qx\"/\"kube-root-ca.crt\"" Jun 11 15:21:16.685930 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.685907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm9qx/must-gather-2dhx9"] Jun 11 15:21:16.743177 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.743144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:16.820027 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.819991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcef5f87-408d-4254-b31a-3eaef1398123-must-gather-output\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.820204 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.820076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snk7k\" (UniqueName: \"kubernetes.io/projected/fcef5f87-408d-4254-b31a-3eaef1398123-kube-api-access-snk7k\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.920946 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.920852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcef5f87-408d-4254-b31a-3eaef1398123-must-gather-output\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.921088 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.920947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snk7k\" (UniqueName: \"kubernetes.io/projected/fcef5f87-408d-4254-b31a-3eaef1398123-kube-api-access-snk7k\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.921162 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.921142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fcef5f87-408d-4254-b31a-3eaef1398123-must-gather-output\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.932508 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.932484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snk7k\" (UniqueName: \"kubernetes.io/projected/fcef5f87-408d-4254-b31a-3eaef1398123-kube-api-access-snk7k\") pod \"must-gather-2dhx9\" (UID: \"fcef5f87-408d-4254-b31a-3eaef1398123\") " pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:16.981638 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:16.981601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" Jun 11 15:21:17.171288 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:17.171204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm9qx/must-gather-2dhx9"] Jun 11 15:21:17.180127 ip-10-0-128-43 kubenswrapper[2581]: W0611 15:21:17.180097 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcef5f87_408d_4254_b31a_3eaef1398123.slice/crio-37c12b9ea2c5d3899a44f7d6288ed598eb1eb26b3b7c8eda9c74f10a44d7f9fb WatchSource:0}: Error finding container 37c12b9ea2c5d3899a44f7d6288ed598eb1eb26b3b7c8eda9c74f10a44d7f9fb: Status 404 returned error can't find the container with id 37c12b9ea2c5d3899a44f7d6288ed598eb1eb26b3b7c8eda9c74f10a44d7f9fb Jun 11 15:21:17.181942 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:17.181923 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:21:18.178191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:18.178161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" event={"ID":"fcef5f87-408d-4254-b31a-3eaef1398123","Type":"ContainerStarted","Data":"37c12b9ea2c5d3899a44f7d6288ed598eb1eb26b3b7c8eda9c74f10a44d7f9fb"} Jun 11 15:21:19.187573 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:19.187523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" event={"ID":"fcef5f87-408d-4254-b31a-3eaef1398123","Type":"ContainerStarted","Data":"288049bf1e8ba1fa55650dba9acebb9e676e0cf9c0d87ce9bb90bd5bd791ed78"} Jun 11 15:21:19.188091 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:19.187588 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" event={"ID":"fcef5f87-408d-4254-b31a-3eaef1398123","Type":"ContainerStarted","Data":"3246444bbb4fbd03a7f0516de87113d50b3512b1ef90a59155a227cce32add37"} Jun 11 15:21:19.210141 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:19.210084 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cm9qx/must-gather-2dhx9" podStartSLOduration=2.216745631 podStartE2EDuration="3.210065164s" totalImagesPullingTime="993.319533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:19.207043694 +0000 UTC m=+1341.528344817" watchObservedRunningTime="2026-06-11 15:21:19.210065164 +0000 UTC m=+1341.531366286" Jun 11 15:21:19.873938 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:19.873905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6f84f_91c6b185-0b9d-4ca5-9abb-81d8351eec75/global-pull-secret-syncer/0.log" Jun 11 15:21:19.965602 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:19.965571 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" Jun 11 15:21:20.048750 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:20.048687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-43.ec2.internal_7241390d053b204124a3c33452facecb/haproxy/0.log" Jun 11 15:21:24.770748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:24.769051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5l8fd_d42381f6-4e2c-4fe0-b919-e9dbb510fc39/manager/0.log" Jun 11 15:21:24.801265 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:24.801233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n9q54_24c1ac90-aab6-4539-9ee1-43bfd6d0ce42/limitador/0.log" Jun 11 15:21:26.657208 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.657176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/alertmanager/0.log" Jun 11 15:21:26.678297 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.678142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/config-reloader/0.log" Jun 11 15:21:26.698885 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.698683 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/kube-rbac-proxy-web/0.log" Jun 11 15:21:26.721675 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.721561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/kube-rbac-proxy/0.log" Jun 11 15:21:26.740651 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.740617 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/kube-rbac-proxy-metric/0.log" Jun 11 15:21:26.763610 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.763582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/prom-label-proxy/0.log" Jun 11 15:21:26.784939 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.784907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a91932-68d2-49d0-b978-86241ba866ff/init-config-reloader/0.log" Jun 11 15:21:26.960090 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:26.960056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-5hwf4_1735a346-4506-47ef-b75d-4566d6547894/monitoring-plugin/0.log" Jun 11 15:21:27.052569 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.052478 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtb2m_b57db7c3-32b2-48ef-91b1-4be39f48e179/node-exporter/0.log" Jun 11 15:21:27.072437 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.072401 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtb2m_b57db7c3-32b2-48ef-91b1-4be39f48e179/kube-rbac-proxy/0.log" Jun 11 15:21:27.093008 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.092976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtb2m_b57db7c3-32b2-48ef-91b1-4be39f48e179/init-textfile/0.log" Jun 11 15:21:27.314427 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.314345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/prometheus/0.log" Jun 11 15:21:27.331462 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.331427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/config-reloader/0.log" Jun 11 15:21:27.350003 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.349968 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/thanos-sidecar/0.log" Jun 11 15:21:27.368555 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.368510 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/kube-rbac-proxy-web/0.log" Jun 11 15:21:27.388957 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.388922 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/kube-rbac-proxy/0.log" Jun 11 15:21:27.418797 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.418753 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/kube-rbac-proxy-thanos/0.log" Jun 11 15:21:27.440523 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.440489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e592cdd8-eff0-48d9-8a55-43a20f758442/init-config-reloader/0.log" Jun 11 15:21:27.470274 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.470239 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-llp5f_97afd2eb-7268-4dc1-9878-d9f97d083454/prometheus-operator/0.log" Jun 11 15:21:27.494062 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.493996 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-llp5f_97afd2eb-7268-4dc1-9878-d9f97d083454/kube-rbac-proxy/0.log" Jun 11 15:21:27.525079 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.525046 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-p5m2v_f77661ad-c73c-4c07-8c2d-f78b51e5bdc6/prometheus-operator-admission-webhook/0.log" Jun 11 15:21:27.575496 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.575275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bc9d99c5d-w4j2v_493961c2-f3bd-4cea-be3b-8201cf1baf34/telemeter-client/0.log" Jun 11 15:21:27.603338 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.603306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bc9d99c5d-w4j2v_493961c2-f3bd-4cea-be3b-8201cf1baf34/reload/0.log" Jun 11 15:21:27.631816 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:27.631772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bc9d99c5d-w4j2v_493961c2-f3bd-4cea-be3b-8201cf1baf34/kube-rbac-proxy/0.log" Jun 11 15:21:29.443051 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:29.442986 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-m64gw_f5c5bf3b-9740-40be-aae1-3f5a589d60f5/networking-console-plugin/0.log" Jun 11 15:21:31.182271 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.182235 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx"] Jun 11 15:21:31.190224 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.190190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.195936 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.195905 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx"] Jun 11 15:21:31.276034 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.275988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-podres\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.276410 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.276377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-proc\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.276542 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.276474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-sys\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.276542 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.276503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-lib-modules\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.276652 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.276550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2t2\" (UniqueName: \"kubernetes.io/projected/46d814ea-4a53-49ff-89d4-a2104b69b198-kube-api-access-lp2t2\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378031 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.377995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-sys\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378031 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-lib-modules\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2t2\" (UniqueName: \"kubernetes.io/projected/46d814ea-4a53-49ff-89d4-a2104b69b198-kube-api-access-lp2t2\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-podres\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-sys\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-proc\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-proc\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378313 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-lib-modules\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.378560 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.378318 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d814ea-4a53-49ff-89d4-a2104b69b198-podres\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.388878 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.388815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2t2\" (UniqueName: \"kubernetes.io/projected/46d814ea-4a53-49ff-89d4-a2104b69b198-kube-api-access-lp2t2\") pod \"perf-node-gather-daemonset-8krlx\" (UID: \"46d814ea-4a53-49ff-89d4-a2104b69b198\") " pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.505296 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.505200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:31.704748 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:31.704689 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx"] Jun 11 15:21:32.283805 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.283415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" event={"ID":"46d814ea-4a53-49ff-89d4-a2104b69b198","Type":"ContainerStarted","Data":"1f7791045c9f5a0ac13cab50a69a2df3b4b6bbbf9a945c8a9db3c9091b34f76a"} Jun 11 15:21:32.283805 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.283483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" event={"ID":"46d814ea-4a53-49ff-89d4-a2104b69b198","Type":"ContainerStarted","Data":"b4e13ab80db2093ccd37c8524598c6a9441af6c16a4fc4984cdf1fc6ab7a5eba"} Jun 11 15:21:32.283805 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.283529 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:32.303429 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.300761 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" podStartSLOduration=1.300738284 podStartE2EDuration="1.300738284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:32.300306331 +0000 UTC m=+1354.621607457" watchObservedRunningTime="2026-06-11 15:21:32.300738284 +0000 UTC m=+1354.622039403" Jun 11 15:21:32.699528 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.699502 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mdk6s_1bf34254-ea68-4c23-9a41-e45238392b35/dns/0.log" Jun 11 15:21:32.718332 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.718293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mdk6s_1bf34254-ea68-4c23-9a41-e45238392b35/kube-rbac-proxy/0.log" Jun 11 15:21:32.820546 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:32.820511 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4kw8_be344747-fa85-4ec3-bdbf-bbe96e6938ea/dns-node-resolver/0.log" Jun 11 15:21:33.380080 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:33.380050 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9pjv8_28a8b668-bbc6-49ca-b054-8a4f1b1b4a47/node-ca/0.log" Jun 11 15:21:34.390109 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:34.390079 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6559bc885d-pjh4n_1f734157-5f71-4d29-8761-b6fb89732183/kube-auth-proxy/0.log" Jun 11 15:21:34.462191 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:34.462163 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8sgzx_8a3a2e68-cf13-474a-8d8d-9343d6296377/payload-pre-processing/0.log" Jun 11 15:21:35.233286 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.233256 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vs4hg_1a07253d-7012-4851-a956-67fe73f789d8/serve-healthcheck-canary/0.log" Jun 11 15:21:35.746665 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.746634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-b7s4j_0d77a079-124b-4718-81f2-0774f58289d9/insights-operator/0.log" Jun 11 15:21:35.748928 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.748904 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-b7s4j_0d77a079-124b-4718-81f2-0774f58289d9/insights-operator/1.log" Jun 11 15:21:35.840875 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.840843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj2td_535c1751-925d-40ed-8b80-94542faee743/kube-rbac-proxy/0.log" Jun 11 15:21:35.865886 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.865857 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj2td_535c1751-925d-40ed-8b80-94542faee743/exporter/0.log" Jun 11 15:21:35.885938 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:35.885905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj2td_535c1751-925d-40ed-8b80-94542faee743/extractor/0.log" Jun 11 15:21:38.301914 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:38.301885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cm9qx/perf-node-gather-daemonset-8krlx" Jun 11 15:21:38.518195 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:38.518160 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk_3f34650c-3382-449b-bc90-b3404a755a3e/manager/0.log" Jun 11 15:21:38.536444 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:38.536410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f8d74d5bf-r5bbk_3f34650c-3382-449b-bc90-b3404a755a3e/copy-manifests/0.log" Jun 11 15:21:39.192488 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:39.192451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7dhjf_ece181b1-40df-415f-ac91-17ac238b5423/konnectivity-agent/0.log" limit=1024 Jun 11 15:21:40.268117 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:40.268064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f7555c9dd-ndlvh_dbcf02bb-0f40-43bd-966e-645e0364d0bb/manager/0.log" Jun 11 15:21:45.839942 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:45.839916 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6559bc885d-pjh4n_1f734157-5f71-4d29-8761-b6fb89732183/kube-auth-proxy/0.log" Jun 11 15:21:45.883988 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:45.883962 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8sgzx_8a3a2e68-cf13-474a-8d8d-9343d6296377/payload-pre-processing/0.log" Jun 11 15:21:47.078936 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.078908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6559bc885d-pjh4n_1f734157-5f71-4d29-8761-b6fb89732183/kube-auth-proxy/0.log" Jun 11 15:21:47.140254 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.140222 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8sgzx_8a3a2e68-cf13-474a-8d8d-9343d6296377/payload-pre-processing/0.log" Jun 11 15:21:47.744876 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.744845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/kube-multus-additional-cni-plugins/0.log" Jun 11 15:21:47.766006 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.765979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/egress-router-binary-copy/0.log" Jun 11 15:21:47.787021 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.786994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/cni-plugins/0.log" Jun 11 15:21:47.808657 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.808628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/bond-cni-plugin/0.log" Jun 11 15:21:47.828478 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.828449 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/routeoverride-cni/0.log" Jun 11 15:21:47.846812 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.846785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/whereabouts-cni-bincopy/0.log" Jun 11 15:21:47.867744 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:47.867703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qsl4_a9baf735-9863-4078-926c-975755339d98/whereabouts-cni/0.log" Jun 11 15:21:48.076245 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:48.076172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gb6j2_c88f0c4e-2887-49d6-8e79-25133e639f9f/kube-multus/0.log" Jun 11 15:21:48.096590 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:48.096565 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tmn7_2f58024c-62a7-451e-84c4-ab34eb1a5e97/network-metrics-daemon/0.log" Jun 11 15:21:48.113838 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:48.113806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tmn7_2f58024c-62a7-451e-84c4-ab34eb1a5e97/kube-rbac-proxy/0.log" Jun 11 15:21:48.830492 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:48.830451 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6559bc885d-pjh4n_1f734157-5f71-4d29-8761-b6fb89732183/kube-auth-proxy/0.log" Jun 11 15:21:48.889436 ip-10-0-128-43 kubenswrapper[2581]: I0611 15:21:48.889386 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8sgzx_8a3a2e68-cf13-474a-8d8d-9343d6296377/payload-pre-processing/0.log"