Jun 14 14:52:53.130965 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 14:52:53.130996 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 14:52:53.131005 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 14:52:53.131304 ip-10-0-139-109 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 14:53:03.294307 ip-10-0-139-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 14:53:03.294328 ip-10-0-139-109 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e5f6677437354e1daded1c8fa4e9299f -- Jun 14 14:55:27.873056 ip-10-0-139-109 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:55:28.226544 ip-10-0-139-109 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:28.226544 ip-10-0-139-109 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:55:28.226544 ip-10-0-139-109 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:28.226544 ip-10-0-139-109 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:55:28.226544 ip-10-0-139-109 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:28.227317 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.226584 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:55:28.231848 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231826 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.231848 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231843 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231878 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231897 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231902 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231905 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231909 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231912 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231915 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231918 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231921 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231923 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231926 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231929 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231932 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231934 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231937 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231940 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231943 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231946 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.231976 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231948 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231951 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231954 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231957 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231959 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231962 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231964 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231967 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231971 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231975 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231977 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231981 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231983 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231986 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.231998 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232009 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232012 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232015 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232017 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.232460 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232020 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232023 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232025 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232030 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232033 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232036 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232039 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232042 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232044 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232047 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232050 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232052 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232055 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232057 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232060 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232064 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232067 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232071 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232073 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232076 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.232945 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232079 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232081 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232084 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232087 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232089 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232092 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232094 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232097 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232100 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232108 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232110 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232113 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232115 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232118 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232120 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232123 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232125 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232128 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232130 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232133 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.233431 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232135 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232138 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232140 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232143 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232146 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232149 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232152 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232155 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232158 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232160 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232163 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232166 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232168 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232171 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232173 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232176 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232178 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232181 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232183 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.232186 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.233939 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233047 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233055 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233060 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233064 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233067 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233070 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233073 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233075 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233078 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233080 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233083 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233086 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233088 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233091 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233094 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233097 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233099 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233102 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233105 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.234427 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233108 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233111 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233113 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233116 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233118 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233121 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233123 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233126 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233128 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233131 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233133 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233136 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233138 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233141 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233143 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233146 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233149 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233151 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233154 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233158 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.234954 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233160 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233162 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233165 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233168 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233170 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233173 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233175 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233178 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233180 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233183 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233185 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233188 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233191 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233194 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233197 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233200 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233202 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233206 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233209 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.235458 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233212 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233215 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233218 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233221 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233223 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233226 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233228 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233231 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233233 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233236 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233238 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233241 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233244 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233247 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233249 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233252 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233255 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233257 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233261 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233264 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.235959 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233266 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233269 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233272 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233274 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233278 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233281 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233284 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233286 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233289 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233291 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233294 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233296 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233299 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233301 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233304 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233306 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233308 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233311 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233313 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233316 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.236451 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233318 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233724 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233731 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233735 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233738 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233741 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233744 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233747 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233749 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233752 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233770 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233772 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233775 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233778 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233781 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233783 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233786 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233789 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233791 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233794 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.236968 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233797 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233800 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233802 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233805 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233807 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233810 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233812 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233815 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233817 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233820 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233822 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233825 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233827 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233831 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233835 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233838 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233841 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233844 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233847 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233850 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.237462 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233852 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233855 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233858 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233860 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233863 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233866 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233868 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233871 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233873 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233876 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233878 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233881 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233883 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233886 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233888 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233890 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233893 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233895 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233898 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233901 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.238061 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233904 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233908 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233911 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233914 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233917 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233919 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233923 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233925 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233928 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233931 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233934 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233936 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233939 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233941 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233946 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233949 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233952 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233955 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233957 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.238547 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233960 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233964 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233966 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233969 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233972 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233975 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233979 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233982 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233985 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233988 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233991 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233993 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233996 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.233998 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234001 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234003 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234006 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234009 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234011 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.239021 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234014 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234016 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234080 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234092 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234097 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234102 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234106 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234110 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234116 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234121 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234124 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234127 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234131 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234135 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234138 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234141 2577 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234144 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234147 2577 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234150 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234153 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234157 2577 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234160 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234163 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234167 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:55:28.239494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234170 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234174 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234176 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234179 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234183 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234186 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234191 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234194 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234197 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234200 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234204 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234207 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234210 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234213 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234216 2577 flags.go:64] FLAG: --enable-server="true" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234219 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234224 2577 flags.go:64] FLAG: --event-burst="100" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234227 2577 flags.go:64] FLAG: --event-qps="50" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234230 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234233 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234236 2577 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234240 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234243 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234245 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234248 2577 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:55:28.240092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234251 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234254 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234258 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234260 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234264 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234267 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234270 2577 flags.go:64] FLAG: --feature-gates="" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234273 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234276 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234279 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234282 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234285 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234288 2577 flags.go:64] FLAG: --help="false" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234292 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234296 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234299 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234302 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234305 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234309 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234312 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234315 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234318 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234321 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:55:28.240731 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234325 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234328 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234331 2577 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234334 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234337 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234340 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234343 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234346 2577 flags.go:64] FLAG: --lock-file="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234349 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234352 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234355 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234360 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234363 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234366 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234368 2577 flags.go:64] FLAG: --logging-format="text" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234371 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234375 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234377 2577 flags.go:64] FLAG: --manifest-url="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234380 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234384 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234387 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234391 2577 flags.go:64] FLAG: --max-pods="110" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234395 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234398 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234401 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:55:28.241354 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234404 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234407 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234410 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234413 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234419 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234423 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234426 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234431 2577 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234434 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234439 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234442 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234445 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234449 2577 flags.go:64] FLAG: --port="10250" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234452 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234454 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e24d89ce39939060" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234458 2577 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234461 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234464 2577 flags.go:64] FLAG: --register-node="true" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234467 2577 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234471 2577 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234474 2577 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234476 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234479 2577 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234483 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234486 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:55:28.242158 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234489 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234492 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234494 2577 flags.go:64] FLAG: --runonce="false" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234497 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234500 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234504 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234507 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234509 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234512 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234515 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234518 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234521 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234524 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234527 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234531 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234534 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234537 2577 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234540 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234545 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234548 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234550 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234561 2577 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234564 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234567 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234570 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:55:28.243140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234572 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234575 2577 flags.go:64] FLAG: --v="2" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234583 2577 flags.go:64] FLAG: --version="false" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234587 2577 flags.go:64] FLAG: --vmodule="" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234591 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.234595 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234700 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234703 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234707 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234710 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234713 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234716 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234720 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234723 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234725 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234728 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234731 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234734 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234737 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234739 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.244288 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234742 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234746 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234749 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234752 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234768 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234771 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234773 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234776 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234779 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234781 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234784 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234787 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234789 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234794 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234798 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234800 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234803 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234806 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234808 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234811 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.245164 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234813 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234816 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234819 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234821 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234825 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234828 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234830 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234834 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234838 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234841 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234844 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234847 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234849 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234854 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234857 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234860 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234863 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234866 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234869 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.246108 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234871 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234874 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234876 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234879 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234881 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234884 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234887 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234889 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234892 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234894 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234897 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234900 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234902 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234905 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234908 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234910 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234913 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234916 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234919 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234923 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.246795 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234926 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234929 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234932 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234934 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234937 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234940 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234943 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234946 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234949 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234951 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234954 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234956 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234959 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234962 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234965 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234968 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234970 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234973 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234976 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234978 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.247348 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234981 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234984 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234986 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234989 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234991 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.234993 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.235519 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.245041 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.245065 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.245093 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.245108 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245193 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245202 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245208 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245212 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.248179 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245216 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245221 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245225 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245229 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245233 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245237 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245242 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245246 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245251 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245255 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245259 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245264 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245268 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245273 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245277 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245281 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245285 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245289 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245293 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245297 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.248923 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245301 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245306 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245310 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245314 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245319 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245324 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245328 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245335 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245342 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245347 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245351 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245356 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245360 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245364 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245369 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245374 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245378 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245383 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245387 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.249408 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245394 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245399 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245404 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245409 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245414 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245418 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245422 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245426 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245431 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245435 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245439 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245444 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245448 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245452 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245456 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245460 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245465 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245469 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245474 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245479 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.249911 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245483 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245488 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245492 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245496 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245500 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245504 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245509 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245513 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245517 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245521 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245526 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245530 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245534 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245538 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245543 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245549 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245556 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245561 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245566 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.250383 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245571 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245575 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245580 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245585 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245590 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245595 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245599 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245603 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245607 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245611 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245616 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245620 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245625 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245629 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245634 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245638 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.250859 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245642 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.245650 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245844 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245854 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245860 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245864 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245869 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245874 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245878 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245882 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245888 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245892 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245896 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245900 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245906 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:28.251256 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245910 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245914 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245919 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245923 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245927 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245931 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245935 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245939 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245944 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245948 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245953 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245957 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245962 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245967 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245971 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245975 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245979 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245983 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245988 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245992 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:28.251623 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.245996 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246001 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246006 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246010 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246014 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246019 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246023 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246027 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246031 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246036 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246040 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246044 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246050 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246054 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246059 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246063 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246067 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246074 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246080 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:28.252138 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246084 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246089 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246093 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246097 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246101 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246106 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246110 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246114 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246118 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246122 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246126 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246129 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246134 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246138 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246142 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246146 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246150 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246154 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246158 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246163 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:28.252609 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246167 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246171 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246175 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246180 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246184 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246188 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246198 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246202 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246206 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246210 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246215 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246219 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246223 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246228 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246232 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246236 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246241 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246246 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246250 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246254 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:28.253126 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246259 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246263 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246267 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246271 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246277 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246284 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:28.246291 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.246299 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.246459 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.249335 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.250711 2577 server.go:1019] "Starting client certificate rotation" Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.250784 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:55:28.253620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.250835 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:55:28.253938 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.252869 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:55:28.254048 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.254028 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:55:28.263422 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.263404 2577 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:55:28.266774 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.266747 2577 log.go:25] "Validated CRI v1 image API" Jun 14 14:55:28.267599 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.267586 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:55:28.272133 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.272114 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7a04b1b1-f200-4f7d-8428-fc11c56c30cc:/dev/nvme0n1p3 f67c4beb-d3ab-4baf-b89a-5d81ba9c1452:/dev/nvme0n1p4] Jun 14 14:55:28.272196 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.272133 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:55:28.276534 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.276512 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:55:28.279387 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.279281 2577 manager.go:216] Machine: {Timestamp:2026-06-14 14:55:28.2779704 +0000 UTC m=+0.295217909 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099883 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2464d6287ce166cf8d828eac1d9582 SystemUUID:ec2464d6-287c-e166-cf8d-828eac1d9582 BootID:e5f66774-3735-4e1d-aded-1c8fa4e9299f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:fc:5a:7d:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:fc:5a:7d:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:82:34:34:11:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:55:28.279387 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.279381 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:55:28.279499 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.279469 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:55:28.282379 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.282354 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:55:28.282519 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.282382 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:55:28.283140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.283131 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:55:28.283176 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.283142 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:55:28.283176 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.283151 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:55:28.283899 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.283889 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:55:28.285612 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.285603 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:55:28.290147 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290136 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:55:28.290263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290254 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:55:28.290295 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290284 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:55:28.290295 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290294 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:55:28.290345 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290311 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:55:28.290345 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290321 2577 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:55:28.290345 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290330 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:55:28.290705 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290694 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:55:28.290750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.290711 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:55:28.293539 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.293517 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:55:28.295235 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295221 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:55:28.295303 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295252 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:55:28.295418 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295407 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:55:28.295467 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295427 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:55:28.295467 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295436 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:55:28.295467 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295441 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:55:28.295467 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295449 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:55:28.295467 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295455 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:55:28.295896 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295887 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:55:28.295896 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295896 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:55:28.295950 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295903 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:55:28.295950 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295910 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:55:28.295950 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295921 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:55:28.295950 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.295929 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:55:28.296615 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.296606 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:55:28.296615 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.296615 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:55:28.297358 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.297340 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxlgz" Jun 14 14:55:28.299473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.299445 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:55:28.300051 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.300038 2577 server.go:1268] "Started kubelet" Jun 14 14:55:28.300102 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.300052 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 14:55:28.300102 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.300051 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:55:28.300196 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.300134 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:55:28.300196 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.300122 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:55:28.300284 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.300196 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:55:28.300928 ip-10-0-139-109 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:55:28.302404 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.302389 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:55:28.302852 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.302832 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:55:28.305004 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.304977 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxlgz" Jun 14 14:55:28.307174 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.306298 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-109.ec2.internal.18b8fa5c9cd2846a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-109.ec2.internal,UID:ip-10-0-139-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-109.ec2.internal,},FirstTimestamp:2026-06-14 14:55:28.300008554 +0000 UTC m=+0.317256063,LastTimestamp:2026-06-14 14:55:28.300008554 +0000 UTC m=+0.317256063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-109.ec2.internal,}" Jun 14 14:55:28.308139 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.308120 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:55:28.308995 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.308973 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:55:28.308995 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.308980 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:55:28.309109 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.309088 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.309620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309602 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:55:28.309819 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309605 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:55:28.309819 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309821 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:55:28.309964 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309862 2577 factory.go:55] Registering systemd factory Jun 14 14:55:28.309964 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309882 2577 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:55:28.309964 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309913 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:55:28.309964 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.309919 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:55:28.310137 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310108 2577 factory.go:153] Registering CRI-O factory Jun 14 14:55:28.310137 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310122 2577 factory.go:223] Registration of the crio container factory successfully Jun 14 14:55:28.310225 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310166 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:55:28.310225 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310184 2577 factory.go:103] Registering Raw factory Jun 14 14:55:28.310225 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310196 2577 manager.go:1196] Started watching for new ooms in manager Jun 14 14:55:28.310632 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.310610 2577 manager.go:349] Starting recovery of all containers Jun 14 14:55:28.311924 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.311614 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 14:55:28.311924 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.311706 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 14:55:28.322924 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.322774 2577 manager.go:354] Recovery completed Jun 14 14:55:28.327099 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.327086 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.329379 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329363 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.329466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329395 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.329466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329408 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.329960 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329945 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:55:28.329960 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329955 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.330086 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329958 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:55:28.330086 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.329993 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:55:28.330610 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.330594 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.330675 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.330622 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.330675 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.330636 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.332182 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.332171 2577 policy_none.go:49] "None policy: Start" Jun 14 14:55:28.332218 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.332186 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:55:28.332218 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.332212 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:55:28.334279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.334269 2577 policy_none.go:47] "Start" Jun 14 14:55:28.369321 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369306 2577 manager.go:337] "Starting Device Plugin manager" Jun 14 14:55:28.369409 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.369338 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:55:28.369409 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369348 2577 server.go:87] "Starting device plugin registration server" Jun 14 14:55:28.369626 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369613 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:55:28.369678 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369628 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:55:28.369736 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369695 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:55:28.369801 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369791 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:55:28.369801 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.369799 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:55:28.370429 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.370409 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:55:28.370520 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.370463 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.386567 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.386539 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:55:28.398322 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.387733 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:55:28.398322 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.387782 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:55:28.398322 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.387808 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:55:28.398322 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.387845 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:55:28.398322 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.390950 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:28.470386 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.470344 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.471531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.471515 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.471631 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.471545 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.471631 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.471556 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.471631 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.471593 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.477513 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.477472 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.477513 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.477492 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-109.ec2.internal\": node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.488646 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.488616 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal"] Jun 14 14:55:28.488737 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.488695 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.489977 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.489965 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.490074 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.489991 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.490074 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.490005 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.490220 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.490106 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.492208 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492193 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.492319 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492305 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.492369 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492343 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.492859 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492846 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.492859 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492865 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.493004 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492896 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.493004 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492936 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.493004 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492961 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.493004 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.492976 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.495365 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.495351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.495416 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.495375 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:28.496028 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.496014 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:28.496106 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.496033 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:28.496106 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.496044 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:28.510362 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.510342 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.514320 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.514303 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-109.ec2.internal\" not found" node="ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.591112 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.591083 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.610453 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.610400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.610537 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.610457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.610537 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.610475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b053dcc90cae7a258548b856c1018fc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"3b053dcc90cae7a258548b856c1018fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.691581 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.691544 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.710833 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.710889 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.710889 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b053dcc90cae7a258548b856c1018fc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"3b053dcc90cae7a258548b856c1018fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.710963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.710963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2360657e869487b61da5661c67006b4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal\" (UID: \"2360657e869487b61da5661c67006b4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.710963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.710915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b053dcc90cae7a258548b856c1018fc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-109.ec2.internal\" (UID: \"3b053dcc90cae7a258548b856c1018fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.792235 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.792162 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.812560 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.812534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.818565 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:28.818548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:28.893195 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.893166 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:28.993751 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:28.993714 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:29.094297 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:29.094219 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:29.194836 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:29.194807 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:29.250279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.250251 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:55:29.250927 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.250430 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:55:29.295312 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:29.295281 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-109.ec2.internal\" not found" Jun 14 14:55:29.302870 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.302850 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:29.309409 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.309388 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:55:29.309409 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.309399 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" Jun 14 14:55:29.311259 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.311231 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:50:28 +0000 UTC" deadline="2028-03-15 05:09:28.084895554 +0000 UTC" Jun 14 14:55:29.311259 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.311253 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15350h13m58.773645534s" Jun 14 14:55:29.318416 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.318387 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:55:29.321366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.321353 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:55:29.322937 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.322922 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" Jun 14 14:55:29.331092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.331075 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:55:29.336837 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:29.336809 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b053dcc90cae7a258548b856c1018fc.slice/crio-766541feae1296b5958771fb7c17889df6842fa045f48b094e99cedcdca1cef3 WatchSource:0}: Error finding container 766541feae1296b5958771fb7c17889df6842fa045f48b094e99cedcdca1cef3: Status 404 returned error can't find the container with id 766541feae1296b5958771fb7c17889df6842fa045f48b094e99cedcdca1cef3 Jun 14 14:55:29.339310 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.339287 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-472xd" Jun 14 14:55:29.341221 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.341207 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:55:29.344766 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.344707 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-472xd" Jun 14 14:55:29.390720 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.390669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"2360657e869487b61da5661c67006b4b","Type":"ContainerStarted","Data":"9382f32455f66dddc596d44e8a3cd56cd2f67440cf97df3cf22d67d4f3b8b914"} Jun 14 14:55:29.391692 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.391670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"3b053dcc90cae7a258548b856c1018fc","Type":"ContainerStarted","Data":"766541feae1296b5958771fb7c17889df6842fa045f48b094e99cedcdca1cef3"} Jun 14 14:55:29.753071 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.752998 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:29.863736 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:29.863533 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:30.292009 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.291980 2577 apiserver.go:52] "Watching apiserver" Jun 14 14:55:30.301292 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.301264 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:55:30.301816 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.301771 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-7k9hn","openshift-ovn-kubernetes/ovnkube-node-nkpqm","kube-system/global-pull-secret-syncer-dr4nv","openshift-cluster-node-tuning-operator/tuned-vklkx","openshift-dns/node-resolver-88562","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal","openshift-multus/multus-additional-cni-plugins-9bwln","openshift-multus/network-metrics-daemon-vdgxn","kube-system/konnectivity-agent-l5lc7","kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr","openshift-image-registry/node-ca-mqkws","openshift-multus/multus-rpb8l","openshift-network-diagnostics/network-check-target-hrqcp"] Jun 14 14:55:30.304553 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.304521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.306649 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.306608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307545 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307569 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307546 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307642 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307675 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgnw7\"" Jun 14 14:55:30.307750 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.307721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:55:30.308724 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.308696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.308866 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.308843 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:30.310367 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.310322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:55:30.310460 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.310329 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrsst\"" Jun 14 14:55:30.311242 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.311211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.313347 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.313326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.316481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.314062 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.316481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.314081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dgkxr\"" Jun 14 14:55:30.316481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.314416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.316681 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.316636 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.317369 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.317057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dxjr\"" Jun 14 14:55:30.317369 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.317184 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.317864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.317844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:30.317953 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.317908 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:30.318191 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318191 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-cni-binary-copy\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-conf\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-os-release\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-cnibin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-netns\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-multus\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-multus-certs\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-modprobe-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2q9\" (UniqueName: \"kubernetes.io/projected/f5973869-e2f3-49b9-b6b8-bfdcc6277464-kube-api-access-6g2q9\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-kubernetes\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-tuned\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5r69\" (UniqueName: \"kubernetes.io/projected/400621f5-9748-4e3b-b084-26aab1a3a06a-kube-api-access-w5r69\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-system-cni-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-k8s-cni-cncf-io\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.318643 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-hostroot\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvfj\" (UniqueName: \"kubernetes.io/projected/ca55e172-86b1-4cfc-9c5c-02603af35e30-kube-api-access-8lvfj\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-run\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-system-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-systemd\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-sys\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-host\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-kubelet\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.318981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-socket-dir-parent\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-daemon-config\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-etc-kubernetes\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-dbus\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-lib-modules\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-tmp\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.319263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cnibin\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-bin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysconfig\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-os-release\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-conf-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-kubelet-config\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.319298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-var-lib-kubelet\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.320175 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.320085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.322343 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.322303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnd96\"" Jun 14 14:55:30.322506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.322490 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:55:30.322668 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.322654 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:55:30.322734 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.322663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.324719 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.324701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.325206 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.325181 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.325344 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.325324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjjt4\"" Jun 14 14:55:30.325570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.325549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:55:30.325679 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.325657 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.327064 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327043 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.327297 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lhsg6\"" Jun 14 14:55:30.327376 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.327437 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:55:30.327437 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.327415 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:30.327720 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327691 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.328005 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327979 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:55:30.328094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.327981 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:55:30.328810 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.328635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:55:30.329932 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.329850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.332495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.332181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.332495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.332316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:55:30.332495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.332370 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prw7m\"" Jun 14 14:55:30.332495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.332489 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.332699 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.332567 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.334215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.334195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:55:30.334454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.334436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:55:30.334605 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.334567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg7xj\"" Jun 14 14:55:30.334694 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.334643 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:55:30.348696 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.348669 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:50:29 +0000 UTC" deadline="2027-12-29 04:44:26.073721326 +0000 UTC" Jun 14 14:55:30.348696 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.348698 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13501h48m55.725027538s" Jun 14 14:55:30.380288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.380262 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:30.411107 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.411083 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:55:30.419719 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvrj\" (UniqueName: \"kubernetes.io/projected/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-kube-api-access-rsvrj\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.419856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-device-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.419856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-conf-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.419856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-var-lib-kubelet\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.419856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-var-lib-kubelet\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.419856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-conf-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d8f56dc-537c-4ed4-a6c9-32193355985d-konnectivity-ca\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gjv\" (UniqueName: \"kubernetes.io/projected/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kube-api-access-25gjv\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef30188-47a8-43ae-9ec9-411f7998c2d0-hosts-file\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.419979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-conf\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-netns\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-env-overrides\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txn2c\" (UniqueName: \"kubernetes.io/projected/317cfac5-b421-41f2-bfa1-f4b165180a51-kube-api-access-txn2c\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.420079 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f347d6c2-9d42-4d65-9313-9c19ecd85263-host-slash\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420087 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-cnibin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-netns\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-netns\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-cnibin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-conf\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-multus\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-multus-certs\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420277 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-multus\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-systemd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-multus-certs\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-log-socket\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysctl-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-tuned\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5r69\" (UniqueName: \"kubernetes.io/projected/400621f5-9748-4e3b-b084-26aab1a3a06a-kube-api-access-w5r69\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.420473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-system-cni-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f347d6c2-9d42-4d65-9313-9c19ecd85263-iptables-alerter-script\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.420474 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-k8s-cni-cncf-io\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-system-cni-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-run-k8s-cni-cncf-io\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.420554 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:30.920532396 +0000 UTC m=+2.937779912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-hostroot\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-run\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-systemd\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-sys\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-host\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-run\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420694 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-hostroot\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-systemd\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-host\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7k7\" (UniqueName: \"kubernetes.io/projected/2ef30188-47a8-43ae-9ec9-411f7998c2d0-kube-api-access-nr7k7\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-dbus\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.420999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-lib-modules\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-netd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-sys\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-script-lib\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317cfac5-b421-41f2-bfa1-f4b165180a51-serviceca\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-lib-modules\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-dbus\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-etc-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-bin\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-binary-copy\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.422316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-socket-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef30188-47a8-43ae-9ec9-411f7998c2d0-tmp-dir\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-os-release\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-kubelet-config\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd6e59e-2c19-493b-af89-15040d3f2255-kubelet-config\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-os-release\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-slash\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-cni-binary-copy\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-os-release\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-modprobe-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2q9\" (UniqueName: \"kubernetes.io/projected/f5973869-e2f3-49b9-b6b8-bfdcc6277464-kube-api-access-6g2q9\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-var-lib-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovn-node-metrics-cert\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-registration-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317cfac5-b421-41f2-bfa1-f4b165180a51-host\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-kubernetes\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.423187 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-etc-selinux\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvfj\" (UniqueName: \"kubernetes.io/projected/ca55e172-86b1-4cfc-9c5c-02603af35e30-kube-api-access-8lvfj\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d8f56dc-537c-4ed4-a6c9-32193355985d-agent-certs\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-systemd-units\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-sys-fs\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk9tt\" (UniqueName: \"kubernetes.io/projected/f347d6c2-9d42-4d65-9313-9c19ecd85263-kube-api-access-vk9tt\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-system-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-os-release\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-kubelet\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-node-log\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-cni-binary-copy\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-modprobe-d\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.421977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-kubelet\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-kubelet\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-socket-dir-parent\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-kubernetes\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.423806 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-daemon-config\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-etc-kubernetes\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-socket-dir-parent\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-tmp\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-system-cni-dir\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cnibin\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-etc-kubernetes\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cnibin\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-bin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysconfig\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-ovn\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca55e172-86b1-4cfc-9c5c-02603af35e30-host-var-lib-cni-bin\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-config\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlgt\" (UniqueName: \"kubernetes.io/projected/f7e60f1d-530d-4508-8c77-5afccfb9e35d-kube-api-access-wtlgt\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.424603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca55e172-86b1-4cfc-9c5c-02603af35e30-multus-daemon-config\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.425215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.425215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-sysconfig\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.425215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.422983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5973869-e2f3-49b9-b6b8-bfdcc6277464-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.425215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.424222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-etc-tuned\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.425215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.424599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400621f5-9748-4e3b-b084-26aab1a3a06a-tmp\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.429699 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.429677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5r69\" (UniqueName: \"kubernetes.io/projected/400621f5-9748-4e3b-b084-26aab1a3a06a-kube-api-access-w5r69\") pod \"tuned-vklkx\" (UID: \"400621f5-9748-4e3b-b084-26aab1a3a06a\") " pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.430629 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.430602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvfj\" (UniqueName: \"kubernetes.io/projected/ca55e172-86b1-4cfc-9c5c-02603af35e30-kube-api-access-8lvfj\") pod \"multus-rpb8l\" (UID: \"ca55e172-86b1-4cfc-9c5c-02603af35e30\") " pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.431246 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.431224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2q9\" (UniqueName: \"kubernetes.io/projected/f5973869-e2f3-49b9-b6b8-bfdcc6277464-kube-api-access-6g2q9\") pod \"multus-additional-cni-plugins-9bwln\" (UID: \"f5973869-e2f3-49b9-b6b8-bfdcc6277464\") " pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.523601 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-node-log\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523601 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-ovn\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-ovn\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-node-log\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-config\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.523864 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlgt\" (UniqueName: \"kubernetes.io/projected/f7e60f1d-530d-4508-8c77-5afccfb9e35d-kube-api-access-wtlgt\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvrj\" (UniqueName: \"kubernetes.io/projected/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-kube-api-access-rsvrj\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-device-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d8f56dc-537c-4ed4-a6c9-32193355985d-konnectivity-ca\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gjv\" (UniqueName: \"kubernetes.io/projected/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kube-api-access-25gjv\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef30188-47a8-43ae-9ec9-411f7998c2d0-hosts-file\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.523996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-netns\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-device-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-run-netns\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-env-overrides\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txn2c\" (UniqueName: \"kubernetes.io/projected/317cfac5-b421-41f2-bfa1-f4b165180a51-kube-api-access-txn2c\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f347d6c2-9d42-4d65-9313-9c19ecd85263-host-slash\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ef30188-47a8-43ae-9ec9-411f7998c2d0-hosts-file\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.524229 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-systemd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-log-socket\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f347d6c2-9d42-4d65-9313-9c19ecd85263-iptables-alerter-script\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-run-systemd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7k7\" (UniqueName: \"kubernetes.io/projected/2ef30188-47a8-43ae-9ec9-411f7998c2d0-kube-api-access-nr7k7\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-netd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-script-lib\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317cfac5-b421-41f2-bfa1-f4b165180a51-serviceca\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-config\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d8f56dc-537c-4ed4-a6c9-32193355985d-konnectivity-ca\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-etc-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-bin\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-etc-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-socket-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.524835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-env-overrides\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef30188-47a8-43ae-9ec9-411f7998c2d0-tmp-dir\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-slash\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f347d6c2-9d42-4d65-9313-9c19ecd85263-host-slash\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-var-lib-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovn-node-metrics-cert\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-netd\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-slash\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-var-lib-openvswitch\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f347d6c2-9d42-4d65-9313-9c19ecd85263-iptables-alerter-script\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-log-socket\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-cni-bin\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-registration-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317cfac5-b421-41f2-bfa1-f4b165180a51-host\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.525625 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef30188-47a8-43ae-9ec9-411f7998c2d0-tmp-dir\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.524987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-etc-selinux\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-socket-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d8f56dc-537c-4ed4-a6c9-32193355985d-agent-certs\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-etc-selinux\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-systemd-units\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-registration-dir\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317cfac5-b421-41f2-bfa1-f4b165180a51-host\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317cfac5-b421-41f2-bfa1-f4b165180a51-serviceca\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-sys-fs\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk9tt\" (UniqueName: \"kubernetes.io/projected/f347d6c2-9d42-4d65-9313-9c19ecd85263-kube-api-access-vk9tt\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-systemd-units\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.525153 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fae29c1f-fc21-4363-adb5-74cbc0a3d883-sys-fs\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.525232 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:31.025211621 +0000 UTC m=+3.042459126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-kubelet\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovnkube-script-lib\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.526454 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.525273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7e60f1d-530d-4508-8c77-5afccfb9e35d-host-kubelet\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.527333 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.527284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7e60f1d-530d-4508-8c77-5afccfb9e35d-ovn-node-metrics-cert\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.527634 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.527617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d8f56dc-537c-4ed4-a6c9-32193355985d-agent-certs\") pod \"konnectivity-agent-l5lc7\" (UID: \"0d8f56dc-537c-4ed4-a6c9-32193355985d\") " pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.529947 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.529918 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:30.529947 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.529945 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:30.530103 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.529958 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:30.530103 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.530029 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:31.029995094 +0000 UTC m=+3.047242604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:30.532365 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.532331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7k7\" (UniqueName: \"kubernetes.io/projected/2ef30188-47a8-43ae-9ec9-411f7998c2d0-kube-api-access-nr7k7\") pod \"node-resolver-88562\" (UID: \"2ef30188-47a8-43ae-9ec9-411f7998c2d0\") " pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.533250 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.533206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk9tt\" (UniqueName: \"kubernetes.io/projected/f347d6c2-9d42-4d65-9313-9c19ecd85263-kube-api-access-vk9tt\") pod \"iptables-alerter-7k9hn\" (UID: \"f347d6c2-9d42-4d65-9313-9c19ecd85263\") " pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.534094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.534071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvrj\" (UniqueName: \"kubernetes.io/projected/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-kube-api-access-rsvrj\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:30.534291 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.534267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gjv\" (UniqueName: \"kubernetes.io/projected/fae29c1f-fc21-4363-adb5-74cbc0a3d883-kube-api-access-25gjv\") pod \"aws-ebs-csi-driver-node-52twr\" (UID: \"fae29c1f-fc21-4363-adb5-74cbc0a3d883\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.534434 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.534406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txn2c\" (UniqueName: \"kubernetes.io/projected/317cfac5-b421-41f2-bfa1-f4b165180a51-kube-api-access-txn2c\") pod \"node-ca-mqkws\" (UID: \"317cfac5-b421-41f2-bfa1-f4b165180a51\") " pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.534531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.534415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlgt\" (UniqueName: \"kubernetes.io/projected/f7e60f1d-530d-4508-8c77-5afccfb9e35d-kube-api-access-wtlgt\") pod \"ovnkube-node-nkpqm\" (UID: \"f7e60f1d-530d-4508-8c77-5afccfb9e35d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.617138 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.617051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9bwln" Jun 14 14:55:30.626073 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.626050 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpb8l" Jun 14 14:55:30.636356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.636332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vklkx" Jun 14 14:55:30.642176 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.642147 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-88562" Jun 14 14:55:30.648125 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.647988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:30.655612 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.655594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7k9hn" Jun 14 14:55:30.662258 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.662237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:30.669920 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.669901 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" Jun 14 14:55:30.676587 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.676570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqkws" Jun 14 14:55:30.927477 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:30.927396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:30.927621 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.927559 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:30.927621 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:30.927616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:31.92760201 +0000 UTC m=+3.944849505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:31.028240 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.028206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:31.028414 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.028342 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:31.028414 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.028403 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:32.02838682 +0000 UTC m=+4.045634328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:31.128966 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.128932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:31.129125 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.129048 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:31.129125 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.129067 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:31.129125 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.129080 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:31.129268 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.129141 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:32.129123178 +0000 UTC m=+4.146370696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:31.239796 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:31.239750 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e60f1d_530d_4508_8c77_5afccfb9e35d.slice/crio-d5a957ad61d6f1704c695690b53c4b13353632583f6e088b14276499ab4652fb WatchSource:0}: Error finding container d5a957ad61d6f1704c695690b53c4b13353632583f6e088b14276499ab4652fb: Status 404 returned error can't find the container with id d5a957ad61d6f1704c695690b53c4b13353632583f6e088b14276499ab4652fb Jun 14 14:55:31.241009 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:31.240986 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef30188_47a8_43ae_9ec9_411f7998c2d0.slice/crio-c024c26ff2fed6134e229106e00cf039e9dce4a18bad87f8df6bc75c65278402 WatchSource:0}: Error finding container c024c26ff2fed6134e229106e00cf039e9dce4a18bad87f8df6bc75c65278402: Status 404 returned error can't find the container with id c024c26ff2fed6134e229106e00cf039e9dce4a18bad87f8df6bc75c65278402 Jun 14 14:55:31.242350 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:31.242143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf347d6c2_9d42_4d65_9313_9c19ecd85263.slice/crio-7e0344abfb9fb55a00193adbdfb6846a87e742a41d2b71e942db168a87f10ff6 WatchSource:0}: Error finding container 7e0344abfb9fb55a00193adbdfb6846a87e742a41d2b71e942db168a87f10ff6: Status 404 returned error can't find the container with id 7e0344abfb9fb55a00193adbdfb6846a87e742a41d2b71e942db168a87f10ff6 Jun 14 14:55:31.245122 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:31.245100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317cfac5_b421_41f2_bfa1_f4b165180a51.slice/crio-938b30cb8871bd504eaa5a05c52398f7f0f9db2b9abda068af45141c819a546d WatchSource:0}: Error finding container 938b30cb8871bd504eaa5a05c52398f7f0f9db2b9abda068af45141c819a546d: Status 404 returned error can't find the container with id 938b30cb8871bd504eaa5a05c52398f7f0f9db2b9abda068af45141c819a546d Jun 14 14:55:31.246883 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:55:31.246864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca55e172_86b1_4cfc_9c5c_02603af35e30.slice/crio-0209b950356d973eb6a19028849ad543e1f38e7819f11b6be2e5ebfeb44426e1 WatchSource:0}: Error finding container 0209b950356d973eb6a19028849ad543e1f38e7819f11b6be2e5ebfeb44426e1: Status 404 returned error can't find the container with id 0209b950356d973eb6a19028849ad543e1f38e7819f11b6be2e5ebfeb44426e1 Jun 14 14:55:31.349163 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.348983 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:50:29 +0000 UTC" deadline="2028-03-17 04:54:39.72554781 +0000 UTC" Jun 14 14:55:31.349163 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.349162 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15397h59m8.376388673s" Jun 14 14:55:31.388420 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.388397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:31.388543 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.388505 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:31.396218 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.396188 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vklkx" event={"ID":"400621f5-9748-4e3b-b084-26aab1a3a06a","Type":"ContainerStarted","Data":"dbd1af77411e590bc842eda6f93de877e495f0227b153d616f2bf90e1459add6"} Jun 14 14:55:31.397574 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.397530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerStarted","Data":"f3302e9d2625837bbccc96a5950fd27f87390b80e5367ea94f154352e6a4fd3f"} Jun 14 14:55:31.398791 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.398750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5lc7" event={"ID":"0d8f56dc-537c-4ed4-a6c9-32193355985d","Type":"ContainerStarted","Data":"f461c6552031eec48a54296bf7fc1e0029a69a0aef00de553c6ceb95e48ef39d"} Jun 14 14:55:31.399964 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.399937 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-88562" event={"ID":"2ef30188-47a8-43ae-9ec9-411f7998c2d0","Type":"ContainerStarted","Data":"c024c26ff2fed6134e229106e00cf039e9dce4a18bad87f8df6bc75c65278402"} Jun 14 14:55:31.402069 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.402046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" event={"ID":"3b053dcc90cae7a258548b856c1018fc","Type":"ContainerStarted","Data":"cb9effcc2cf772169faef7fa0c3acf59a82947c30627249fbcb853683e5c35bc"} Jun 14 14:55:31.403304 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.403283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" event={"ID":"fae29c1f-fc21-4363-adb5-74cbc0a3d883","Type":"ContainerStarted","Data":"15c069d889cfe46d1990709afafe151dbed776d5340614a0691944d855401830"} Jun 14 14:55:31.406115 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.406092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpb8l" event={"ID":"ca55e172-86b1-4cfc-9c5c-02603af35e30","Type":"ContainerStarted","Data":"0209b950356d973eb6a19028849ad543e1f38e7819f11b6be2e5ebfeb44426e1"} Jun 14 14:55:31.408090 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.408069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqkws" event={"ID":"317cfac5-b421-41f2-bfa1-f4b165180a51","Type":"ContainerStarted","Data":"938b30cb8871bd504eaa5a05c52398f7f0f9db2b9abda068af45141c819a546d"} Jun 14 14:55:31.409228 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.409205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7k9hn" event={"ID":"f347d6c2-9d42-4d65-9313-9c19ecd85263","Type":"ContainerStarted","Data":"7e0344abfb9fb55a00193adbdfb6846a87e742a41d2b71e942db168a87f10ff6"} Jun 14 14:55:31.410363 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.410342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"d5a957ad61d6f1704c695690b53c4b13353632583f6e088b14276499ab4652fb"} Jun 14 14:55:31.415240 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.415192 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-109.ec2.internal" podStartSLOduration=2.415181283 podStartE2EDuration="2.415181283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:31.415051215 +0000 UTC m=+3.432298753" watchObservedRunningTime="2026-06-14 14:55:31.415181283 +0000 UTC m=+3.432428800" Jun 14 14:55:31.935456 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:31.935286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:31.935456 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.935455 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:31.935674 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:31.935517 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:33.935499611 +0000 UTC m=+5.952747121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:32.036481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.035855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:32.036481 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.036006 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:32.036481 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.036099 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:34.036078883 +0000 UTC m=+6.053326385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:32.136597 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.136564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:32.136805 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.136743 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:32.136805 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.136781 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:32.136805 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.136795 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:32.136972 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.136854 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:34.136835286 +0000 UTC m=+6.154082803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:32.391844 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.391775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:32.392270 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.391899 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:32.392338 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.392288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:32.392390 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:32.392377 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:32.432139 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.432100 2577 generic.go:356] "Generic (PLEG): container finished" podID="2360657e869487b61da5661c67006b4b" containerID="d285ecb8ed9f58e8f71c03dc5aebeafe91749fce06dab90c64a35e9cee0fed9a" exitCode=0 Jun 14 14:55:32.433059 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:32.433031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"2360657e869487b61da5661c67006b4b","Type":"ContainerDied","Data":"d285ecb8ed9f58e8f71c03dc5aebeafe91749fce06dab90c64a35e9cee0fed9a"} Jun 14 14:55:33.388933 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:33.388894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:33.389119 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:33.389057 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:33.455198 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:33.455163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" event={"ID":"2360657e869487b61da5661c67006b4b","Type":"ContainerStarted","Data":"1493cc3ec96365d458cc378253ab260dfd74e84e6b36f4e3aa8f8cda8ff8d690"} Jun 14 14:55:33.470780 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:33.470715 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-109.ec2.internal" podStartSLOduration=4.4706944029999995 podStartE2EDuration="4.470694403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:33.469878904 +0000 UTC m=+5.487126424" watchObservedRunningTime="2026-06-14 14:55:33.470694403 +0000 UTC m=+5.487941922" Jun 14 14:55:33.954357 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:33.954317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:33.954549 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:33.954456 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:33.954619 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:33.954554 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:37.954533687 +0000 UTC m=+9.971781188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:34.056133 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:34.055544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:34.056133 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.055703 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:34.056133 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.055782 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:38.055747634 +0000 UTC m=+10.072995129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:34.156188 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:34.156144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:34.156350 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.156298 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:34.156350 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.156317 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:34.156350 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.156328 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:34.156517 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.156386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:38.15636745 +0000 UTC m=+10.173614966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:34.388718 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:34.388640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:34.388896 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.388792 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:34.389103 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:34.388640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:34.389103 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:34.389069 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:35.388705 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:35.388663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:35.389159 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:35.388827 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:36.388604 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:36.388571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:36.388604 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:36.388619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:36.389162 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:36.388717 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:36.389162 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:36.389003 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:37.388858 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:37.388619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:37.388858 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:37.388777 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:37.987356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:37.987320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:37.987522 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:37.987473 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:37.987596 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:37.987549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:45.987529565 +0000 UTC m=+18.004777075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:38.087954 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:38.087914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:38.088121 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.088081 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:38.088192 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.088151 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:46.088131894 +0000 UTC m=+18.105379394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:38.189198 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:38.188898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:38.189198 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.189063 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:38.189198 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.189082 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:38.189198 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.189094 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:38.189198 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.189158 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:46.189139369 +0000 UTC m=+18.206386871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:38.391646 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:38.391545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:38.392103 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.391660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:38.392103 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:38.391740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:38.392103 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:38.391854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:39.388377 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:39.388315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:39.388556 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:39.388470 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:40.391978 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:40.391830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:40.391978 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:40.391845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:40.391978 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:40.391956 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:40.392537 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:40.392103 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:41.388831 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:41.388794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:41.388974 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:41.388951 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:42.389006 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:42.388975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:42.389501 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:42.389049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:42.389501 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:42.389161 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:42.389501 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:42.389253 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:43.388616 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:43.388588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:43.388785 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:43.388716 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:44.389121 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:44.389083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:44.389668 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:44.389216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:44.389668 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:44.389269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:44.389668 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:44.389364 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:45.388146 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:45.388070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:45.388285 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:45.388187 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:46.041422 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:46.041383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:46.041906 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.041502 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:46.041906 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.041570 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:02.041553902 +0000 UTC m=+34.058801398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:46.142644 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:46.142606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:46.142816 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.142744 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:46.142877 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.142827 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:02.142811205 +0000 UTC m=+34.160058702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:46.243231 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:46.243186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:46.243371 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.243350 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:46.243434 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.243373 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:46.243434 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.243387 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:46.243504 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.243448 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:02.243433866 +0000 UTC m=+34.260681361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:46.391969 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:46.391888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:46.392131 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:46.391897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:46.392131 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.392023 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:46.392131 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:46.392091 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:47.388013 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:47.387976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:47.388437 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:47.388137 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:48.389251 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:48.389145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:48.389648 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:48.389265 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:48.389648 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:48.389313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:48.389648 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:48.389434 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:49.388503 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:49.388471 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:49.388667 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:49.388583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:50.388563 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.388252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:50.389337 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.388305 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:50.389337 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:50.388649 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:50.389337 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:50.388705 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:50.494973 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.494895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-88562" event={"ID":"2ef30188-47a8-43ae-9ec9-411f7998c2d0","Type":"ContainerStarted","Data":"716c9d8f108fab630f6c19e773693dee7ff7587f8850799c5a778f3fee7e2bb2"} Jun 14 14:55:50.496913 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.496886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" event={"ID":"fae29c1f-fc21-4363-adb5-74cbc0a3d883","Type":"ContainerStarted","Data":"5f7f1258578973e65141c7e848ff33703de06db7c69d890f9a8abbcad037b5ab"} Jun 14 14:55:50.498593 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.498564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpb8l" event={"ID":"ca55e172-86b1-4cfc-9c5c-02603af35e30","Type":"ContainerStarted","Data":"575f50932275548601217e4ef1909701a0e4b12045c1eee0bfc51ff60386e6cb"} Jun 14 14:55:50.500491 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.500466 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqkws" event={"ID":"317cfac5-b421-41f2-bfa1-f4b165180a51","Type":"ContainerStarted","Data":"0363ebdc0b911d4cb39c010ceb7b25c9b93f36874721c44a05c7a0a120d93bca"} Jun 14 14:55:50.503473 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.503457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 14:55:50.503853 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.503827 2577 generic.go:356] "Generic (PLEG): container finished" podID="f7e60f1d-530d-4508-8c77-5afccfb9e35d" containerID="594bc784a2a8f0347b21640513d55d585e1e301bb1a7c04f414b0666573bf88b" exitCode=1 Jun 14 14:55:50.503963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.503896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"e42c79665dd240a760e10615ad983c972936c20138863e658d60a15d94314cdd"} Jun 14 14:55:50.503963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.503958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"6dc9c02d38675a4a24a4cae451efb40e736d9ed39092fd075f96042318d7066e"} Jun 14 14:55:50.504069 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.504008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"c7074cc9375df0b7e1a40e72759ce76e5729337e88b7df886eadfab75118cd83"} Jun 14 14:55:50.504069 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.504058 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerDied","Data":"594bc784a2a8f0347b21640513d55d585e1e301bb1a7c04f414b0666573bf88b"} Jun 14 14:55:50.504168 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.504108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"931694eb22ede4878f53d1170fda32442fcc8799b508f8bdb2ebff683e3bbcf7"} Jun 14 14:55:50.505370 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.505348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vklkx" event={"ID":"400621f5-9748-4e3b-b084-26aab1a3a06a","Type":"ContainerStarted","Data":"ce9a3e7c5e3deab1f97b7f1f85cb8fb66af46ea013dd6648be714240e5d7325e"} Jun 14 14:55:50.506844 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.506820 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="ca8e0e5d5740f91bf9dab7189310b7813e37570fdcdf164790fe0bf50bc90a72" exitCode=0 Jun 14 14:55:50.506920 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.506890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"ca8e0e5d5740f91bf9dab7189310b7813e37570fdcdf164790fe0bf50bc90a72"} Jun 14 14:55:50.508458 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.508437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5lc7" event={"ID":"0d8f56dc-537c-4ed4-a6c9-32193355985d","Type":"ContainerStarted","Data":"585cded34a3790408a3fb1d21e631f75fe68f4511ac7f5033814bc02d6815cbb"} Jun 14 14:55:50.509081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.509041 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-88562" podStartSLOduration=4.112129683 podStartE2EDuration="22.509024993s" totalImagesPullingTime="18.39689531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:50.508302482 +0000 UTC m=+22.525550002" watchObservedRunningTime="2026-06-14 14:55:50.509024993 +0000 UTC m=+22.526272512" Jun 14 14:55:50.560606 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.560553 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rpb8l" podStartSLOduration=4.113790781 podStartE2EDuration="22.560533639s" totalImagesPullingTime="18.446742858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:50.542562912 +0000 UTC m=+22.559810430" watchObservedRunningTime="2026-06-14 14:55:50.560533639 +0000 UTC m=+22.577781150" Jun 14 14:55:50.561029 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.560999 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vklkx" podStartSLOduration=4.172948298 podStartE2EDuration="22.560987806s" totalImagesPullingTime="18.388039508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:50.560415544 +0000 UTC m=+22.577663062" watchObservedRunningTime="2026-06-14 14:55:50.560987806 +0000 UTC m=+22.578235324" Jun 14 14:55:50.573666 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.573612 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mqkws" podStartSLOduration=4.180454366 podStartE2EDuration="22.573602164s" totalImagesPullingTime="18.393147798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:50.573415143 +0000 UTC m=+22.590662681" watchObservedRunningTime="2026-06-14 14:55:50.573602164 +0000 UTC m=+22.590849682" Jun 14 14:55:50.914710 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:50.914678 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:55:51.385695 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.385592 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:55:50.914702404Z","UUID":"63327a7e-4e9c-4965-8362-b90873708d85","Handler":null,"Name":"","Endpoint":""} Jun 14 14:55:51.387549 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.387525 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:55:51.387669 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.387566 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:55:51.388180 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.388134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:51.388280 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:51.388242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:51.513125 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.513030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" event={"ID":"fae29c1f-fc21-4363-adb5-74cbc0a3d883","Type":"ContainerStarted","Data":"29249b837f2d5969aeb611131757a5f9d5ff652c93e3a4633c9034d9bad11b54"} Jun 14 14:55:51.514737 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.514706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7k9hn" event={"ID":"f347d6c2-9d42-4d65-9313-9c19ecd85263","Type":"ContainerStarted","Data":"fea7614d7d746a644bc6fc9c553c6b163f8757a95cb0120c7d32fffe18d99591"} Jun 14 14:55:51.518077 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.518058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 14:55:51.518488 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.518431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"f146adba4a0174b5c861f02e0487280df43ee9169fe2dc6cae18e2b36a80bb9c"} Jun 14 14:55:51.529553 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.529508 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l5lc7" podStartSLOduration=5.14095171 podStartE2EDuration="23.529487706s" totalImagesPullingTime="18.388535996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:50.587672771 +0000 UTC m=+22.604920295" watchObservedRunningTime="2026-06-14 14:55:51.529487706 +0000 UTC m=+23.546735222" Jun 14 14:55:51.530018 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.529975 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7k9hn" podStartSLOduration=5.096596723 podStartE2EDuration="23.529965787s" totalImagesPullingTime="18.433369064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:51.529558605 +0000 UTC m=+23.546806122" watchObservedRunningTime="2026-06-14 14:55:51.529965787 +0000 UTC m=+23.547213309" Jun 14 14:55:51.891707 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.891404 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:51.892043 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:51.892020 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:52.388043 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.387971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:52.388191 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:52.388095 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:52.388268 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.388218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:52.388356 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:52.388329 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:52.522591 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.522551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" event={"ID":"fae29c1f-fc21-4363-adb5-74cbc0a3d883","Type":"ContainerStarted","Data":"909f716039c775e341b5ab8faa53e87d68d3154b1fc62c798c15a48ef4c29eef"} Jun 14 14:55:52.523072 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.523054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:52.523424 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.523409 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l5lc7" Jun 14 14:55:52.539506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:52.539420 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52twr" podStartSLOduration=4.16576191 podStartE2EDuration="24.539360283s" totalImagesPullingTime="20.373598373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:52.538881444 +0000 UTC m=+24.556128974" watchObservedRunningTime="2026-06-14 14:55:52.539360283 +0000 UTC m=+24.556607795" Jun 14 14:55:53.388545 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:53.388508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:53.388700 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:53.388652 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:53.527582 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:53.527555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 14:55:53.528057 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:53.527954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"75b0a45e2d40a0e511115e119d258333e9774be395b06e039643aa517712e51f"} Jun 14 14:55:54.388167 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:54.388124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:54.388328 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:54.388248 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:54.388328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:54.388303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:54.388433 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:54.388409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:55.388243 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.388055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:55.388890 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:55.388340 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:55.535038 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.535011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 14:55:55.535400 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.535377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"833470ed7ba5cc78700a35f988ecd3a8a61ec26a88321bd6090db0694979fd80"} Jun 14 14:55:55.535630 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.535609 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:55.535767 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.535682 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:55.535856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.535813 2577 scope.go:117] "RemoveContainer" containerID="594bc784a2a8f0347b21640513d55d585e1e301bb1a7c04f414b0666573bf88b" Jun 14 14:55:55.537349 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.537329 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="b4ee05fcde4062177611441301e6ae6764827d007e68af2a64c58f357b3d8ac2" exitCode=0 Jun 14 14:55:55.537438 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.537361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"b4ee05fcde4062177611441301e6ae6764827d007e68af2a64c58f357b3d8ac2"} Jun 14 14:55:55.551472 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:55.551454 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:56.388157 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.388121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:56.388315 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:56.388233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:56.388315 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.388288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:56.388583 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:56.388426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:56.544445 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.544407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"4f0cee047c570ce514085cedf761d80b000bf485991d4a69cc65354bbdaa1503"} Jun 14 14:55:56.545713 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.543140 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="4f0cee047c570ce514085cedf761d80b000bf485991d4a69cc65354bbdaa1503" exitCode=0 Jun 14 14:55:56.555460 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.555437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 14:55:56.555905 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.555877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" event={"ID":"f7e60f1d-530d-4508-8c77-5afccfb9e35d","Type":"ContainerStarted","Data":"4a1a72f95a88c1607373c55a364aeeeac4c28b5e8db66db9053a924b8bf641b6"} Jun 14 14:55:56.556178 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.556153 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:56.572709 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.572682 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:55:56.586288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:56.586247 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" podStartSLOduration=10.107607785 podStartE2EDuration="28.586233191s" totalImagesPullingTime="18.478625406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:56.584853167 +0000 UTC m=+28.602100695" watchObservedRunningTime="2026-06-14 14:55:56.586233191 +0000 UTC m=+28.603480709" Jun 14 14:55:57.217771 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.217564 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dr4nv"] Jun 14 14:55:57.217874 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.217863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:57.218017 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:57.217981 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:55:57.224082 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.223917 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdgxn"] Jun 14 14:55:57.224484 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.224458 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:57.225010 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.224986 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hrqcp"] Jun 14 14:55:57.225120 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:57.224986 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:57.225120 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.225065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:57.225233 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:57.225145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:57.560268 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.560181 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="fb53bf3c1af3f2d7dc009632693fba4e5a6095598d92dc1673e88ae28ef883a2" exitCode=0 Jun 14 14:55:57.560697 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:57.560268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"fb53bf3c1af3f2d7dc009632693fba4e5a6095598d92dc1673e88ae28ef883a2"} Jun 14 14:55:58.389700 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:58.389670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:55:58.389902 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:58.389781 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:55:59.388009 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:59.387983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:55:59.388671 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:55:59.387990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:55:59.388671 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:59.388105 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:55:59.388671 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:55:59.388149 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:56:00.389097 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:00.389061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:00.389554 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:00.389192 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:56:01.388239 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:01.388200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:56:01.388414 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:01.388200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:01.388414 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:01.388325 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:56:01.388523 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:01.388427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:56:02.065780 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:02.065729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:02.066238 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.065869 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:56:02.066238 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.065931 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret podName:cbd6e59e-2c19-493b-af89-15040d3f2255 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:34.0659153 +0000 UTC m=+66.083162805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret") pod "global-pull-secret-syncer-dr4nv" (UID: "cbd6e59e-2c19-493b-af89-15040d3f2255") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:56:02.166856 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:02.166825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:56:02.167000 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.166969 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:56:02.167040 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.167026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:34.167008451 +0000 UTC m=+66.184255963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:56:02.267619 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:02.267586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:02.267800 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.267714 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:56:02.267800 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.267726 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:56:02.267800 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.267736 2577 projected.go:196] Error preparing data for projected volume kube-api-access-svt9b for pod openshift-network-diagnostics/network-check-target-hrqcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:56:02.267901 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.267805 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b podName:d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:34.267792125 +0000 UTC m=+66.285039621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-svt9b" (UniqueName: "kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b") pod "network-check-target-hrqcp" (UID: "d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:56:02.391270 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:02.391247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:02.391377 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:02.391338 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrqcp" podUID="d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3" Jun 14 14:56:02.574636 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:02.574604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerStarted","Data":"fca34cd46ab4a0b408acfa0f6634ef2c4d9f04307435b14a63f0d51100bdc35c"} Jun 14 14:56:03.388109 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.388081 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:03.388537 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.388086 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:56:03.388537 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:03.388211 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dr4nv" podUID="cbd6e59e-2c19-493b-af89-15040d3f2255" Jun 14 14:56:03.388537 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:03.388257 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:56:03.579335 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.579301 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="fca34cd46ab4a0b408acfa0f6634ef2c4d9f04307435b14a63f0d51100bdc35c" exitCode=0 Jun 14 14:56:03.579335 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.579341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"fca34cd46ab4a0b408acfa0f6634ef2c4d9f04307435b14a63f0d51100bdc35c"} Jun 14 14:56:03.763211 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.763038 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-109.ec2.internal" event="NodeReady" Jun 14 14:56:03.763370 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.763358 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:56:03.808243 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.808209 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5vxz"] Jun 14 14:56:03.819165 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.819017 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlpxm"] Jun 14 14:56:03.819325 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.819246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:03.821584 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.821560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:56:03.821718 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.821658 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:56:03.821718 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.821687 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 14:56:03.831134 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.831113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5vxz"] Jun 14 14:56:03.831244 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.831154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlpxm"] Jun 14 14:56:03.831244 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.831226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:03.833816 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.833796 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:56:03.833901 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.833837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:56:03.833901 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.833850 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8bswm\"" Jun 14 14:56:03.833901 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.833839 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:56:03.978548 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-config-volume\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:03.978699 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqqj\" (UniqueName: \"kubernetes.io/projected/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-kube-api-access-hqqqj\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:03.978699 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:03.978699 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-tmp-dir\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:03.978831 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33b5b70f-f79c-4a8e-9990-9708adad8f45-cert\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:03.978831 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:03.978742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm4rc\" (UniqueName: \"kubernetes.io/projected/33b5b70f-f79c-4a8e-9990-9708adad8f45-kube-api-access-dm4rc\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.079104 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqqj\" (UniqueName: \"kubernetes.io/projected/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-kube-api-access-hqqqj\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.079279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.079279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-tmp-dir\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.079279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33b5b70f-f79c-4a8e-9990-9708adad8f45-cert\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.079279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm4rc\" (UniqueName: \"kubernetes.io/projected/33b5b70f-f79c-4a8e-9990-9708adad8f45-kube-api-access-dm4rc\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.079279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-config-volume\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.079571 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.079547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-tmp-dir\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.079686 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:04.079670 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:04.079774 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:04.079749 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:04.579725627 +0000 UTC m=+36.596973129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:04.083296 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.083278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33b5b70f-f79c-4a8e-9990-9708adad8f45-cert\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.087164 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.087141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm4rc\" (UniqueName: \"kubernetes.io/projected/33b5b70f-f79c-4a8e-9990-9708adad8f45-kube-api-access-dm4rc\") pod \"ingress-canary-zlpxm\" (UID: \"33b5b70f-f79c-4a8e-9990-9708adad8f45\") " pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.089068 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.089041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-config-volume\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.090672 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.090650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqqj\" (UniqueName: \"kubernetes.io/projected/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-kube-api-access-hqqqj\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.139868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.139828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlpxm" Jun 14 14:56:04.313877 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.313825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlpxm"] Jun 14 14:56:04.317615 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:56:04.317584 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b5b70f_f79c_4a8e_9990_9708adad8f45.slice/crio-4fb50642b3a86fe4376f3d1d5e1f8a0399b590966d62bc3c2199e68254567e70 WatchSource:0}: Error finding container 4fb50642b3a86fe4376f3d1d5e1f8a0399b590966d62bc3c2199e68254567e70: Status 404 returned error can't find the container with id 4fb50642b3a86fe4376f3d1d5e1f8a0399b590966d62bc3c2199e68254567e70 Jun 14 14:56:04.389000 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.388962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:04.391588 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.391566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:56:04.391712 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.391567 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:56:04.391712 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.391568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:56:04.582587 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.582497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlpxm" event={"ID":"33b5b70f-f79c-4a8e-9990-9708adad8f45","Type":"ContainerStarted","Data":"4fb50642b3a86fe4376f3d1d5e1f8a0399b590966d62bc3c2199e68254567e70"} Jun 14 14:56:04.583121 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.583103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:04.583210 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:04.583195 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:04.583276 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:04.583266 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:05.583246961 +0000 UTC m=+37.600494459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:04.585570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.585537 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5973869-e2f3-49b9-b6b8-bfdcc6277464" containerID="75e8f40f6e9dd3a910dda4f9b15d9f1cfea28ece0576918c77db1cc27a9b487c" exitCode=0 Jun 14 14:56:04.585668 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:04.585574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerDied","Data":"75e8f40f6e9dd3a910dda4f9b15d9f1cfea28ece0576918c77db1cc27a9b487c"} Jun 14 14:56:05.388341 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.388156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:56:05.388540 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.388217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:05.390853 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.390824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:56:05.391206 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.390886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 14:56:05.391872 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.391855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:56:05.591896 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.591846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:05.592106 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.591900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9bwln" event={"ID":"f5973869-e2f3-49b9-b6b8-bfdcc6277464","Type":"ContainerStarted","Data":"998b3b60e5708351ca184f12552037c2cda486e111e8cff3a76b4ef2c04dff20"} Jun 14 14:56:05.592106 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:05.591970 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:05.592106 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:05.592038 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:07.592015839 +0000 UTC m=+39.609263335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:05.612689 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:05.612637 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9bwln" podStartSLOduration=8.28444202 podStartE2EDuration="37.612619748s" totalImagesPullingTime="29.328177728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:05.611341304 +0000 UTC m=+37.628588822" watchObservedRunningTime="2026-06-14 14:56:05.612619748 +0000 UTC m=+37.629867307" Jun 14 14:56:07.597434 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:07.597400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlpxm" event={"ID":"33b5b70f-f79c-4a8e-9990-9708adad8f45","Type":"ContainerStarted","Data":"4fe7287e44b457fe50d50a3d6755d3d866f314547617117b7ac0cf5ed481172f"} Jun 14 14:56:07.608262 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:07.608240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:07.608353 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:07.608331 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:07.608388 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:07.608377 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:11.608364874 +0000 UTC m=+43.625612371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:07.612716 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:07.612678 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlpxm" podStartSLOduration=2.283401296 podStartE2EDuration="4.612663734s" totalImagesPullingTime="2.329262438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:07.612065467 +0000 UTC m=+39.629312986" watchObservedRunningTime="2026-06-14 14:56:07.612663734 +0000 UTC m=+39.629911251" Jun 14 14:56:11.636464 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:11.636426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:11.636967 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:11.636533 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:11.636967 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:11.636583 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:19.636568881 +0000 UTC m=+51.653816378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:19.698204 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:19.698169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:19.698879 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:19.698323 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:19.698879 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:19.698412 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:35.698390698 +0000 UTC m=+67.715638207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:28.572810 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:28.572780 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkpqm" Jun 14 14:56:34.095494 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.095457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:34.098011 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.097991 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:56:34.109028 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.109007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd6e59e-2c19-493b-af89-15040d3f2255-original-pull-secret\") pod \"global-pull-secret-syncer-dr4nv\" (UID: \"cbd6e59e-2c19-493b-af89-15040d3f2255\") " pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:34.196431 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.196399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:56:34.198898 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.198876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:56:34.205817 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.205799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dr4nv" Jun 14 14:56:34.206886 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:34.206869 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:56:34.206962 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:34.206949 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:57:38.206924098 +0000 UTC m=+130.224171596 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : secret "metrics-daemon-secret" not found Jun 14 14:56:34.297045 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.297015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:34.299745 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.299725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:56:34.310285 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.310129 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:56:34.321499 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.321473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svt9b\" (UniqueName: \"kubernetes.io/projected/d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3-kube-api-access-svt9b\") pod \"network-check-target-hrqcp\" (UID: \"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3\") " pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:34.365449 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.365368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dr4nv"] Jun 14 14:56:34.368166 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:56:34.368129 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd6e59e_2c19_493b_af89_15040d3f2255.slice/crio-cbf8abffa1f864204abd53d90afbbefcccb648365b11434d483a19a6ef98c5dd WatchSource:0}: Error finding container cbf8abffa1f864204abd53d90afbbefcccb648365b11434d483a19a6ef98c5dd: Status 404 returned error can't find the container with id cbf8abffa1f864204abd53d90afbbefcccb648365b11434d483a19a6ef98c5dd Jun 14 14:56:34.399939 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.399916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:56:34.407983 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.407968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:34.523279 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.523250 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hrqcp"] Jun 14 14:56:34.525884 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:56:34.525859 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ea7ef2_2969_4a84_8f34_77d0e6a03cb3.slice/crio-cebfdd5b2f0c307b883e16f31e65e2e618f0cfa6b107b34ff3dfea5e6fc0f78e WatchSource:0}: Error finding container cebfdd5b2f0c307b883e16f31e65e2e618f0cfa6b107b34ff3dfea5e6fc0f78e: Status 404 returned error can't find the container with id cebfdd5b2f0c307b883e16f31e65e2e618f0cfa6b107b34ff3dfea5e6fc0f78e Jun 14 14:56:34.661637 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.661547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hrqcp" event={"ID":"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3","Type":"ContainerStarted","Data":"cebfdd5b2f0c307b883e16f31e65e2e618f0cfa6b107b34ff3dfea5e6fc0f78e"} Jun 14 14:56:34.662646 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:34.662624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dr4nv" event={"ID":"cbd6e59e-2c19-493b-af89-15040d3f2255","Type":"ContainerStarted","Data":"cbf8abffa1f864204abd53d90afbbefcccb648365b11434d483a19a6ef98c5dd"} Jun 14 14:56:35.704718 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:35.704677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:56:35.705179 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:35.704873 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:35.705179 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:56:35.704945 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:57:07.704923859 +0000 UTC m=+99.722171358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:56:39.677737 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:39.677700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hrqcp" event={"ID":"d3ea7ef2-2969-4a84-8f34-77d0e6a03cb3","Type":"ContainerStarted","Data":"cc5162de8698f70fc4dfd0a101ad37ff34713fe528ee0a8798db64af4d09706a"} Jun 14 14:56:39.678198 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:39.677861 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:56:39.679029 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:39.678999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dr4nv" event={"ID":"cbd6e59e-2c19-493b-af89-15040d3f2255","Type":"ContainerStarted","Data":"2411969ddd542743a2ca26da528ca6d6eb7df3d0ee70f801521a57cde840a31c"} Jun 14 14:56:39.695260 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:39.695222 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hrqcp" podStartSLOduration=67.3908562 podStartE2EDuration="1m11.695210323s" totalImagesPullingTime="4.304354123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:39.69412428 +0000 UTC m=+71.711371797" watchObservedRunningTime="2026-06-14 14:56:39.695210323 +0000 UTC m=+71.712457819" Jun 14 14:56:39.708059 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:56:39.708016 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dr4nv" podStartSLOduration=67.242460757 podStartE2EDuration="1m11.708004492s" totalImagesPullingTime="4.465543735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:39.707532324 +0000 UTC m=+71.724779839" watchObservedRunningTime="2026-06-14 14:56:39.708004492 +0000 UTC m=+71.725252010" Jun 14 14:57:07.721778 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:57:07.721729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:57:07.722294 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:57:07.721920 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:57:07.722294 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:57:07.722013 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:11.721990944 +0000 UTC m=+163.739238442 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:57:10.683932 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:57:10.683896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hrqcp" Jun 14 14:57:38.226116 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:57:38.226078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:57:38.226610 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:57:38.226183 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:57:38.226610 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:57:38.226235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs podName:5a1b6bc7-df6a-455f-9fac-140299fd2ce2 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:40.226222125 +0000 UTC m=+252.243469621 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs") pod "network-metrics-daemon-vdgxn" (UID: "5a1b6bc7-df6a-455f-9fac-140299fd2ce2") : secret "metrics-daemon-secret" not found Jun 14 14:58:06.829132 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:06.829075 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s5vxz" podUID="3235f6e0-17e1-4ecc-93f0-31c4643c9d94" Jun 14 14:58:06.883000 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:06.882974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5vxz" Jun 14 14:58:08.400092 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:08.400058 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vdgxn" podUID="5a1b6bc7-df6a-455f-9fac-140299fd2ce2" Jun 14 14:58:11.755512 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:11.755470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 14:58:11.755981 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:11.755609 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:58:11.755981 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:11.755671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls podName:3235f6e0-17e1-4ecc-93f0-31c4643c9d94 nodeName:}" failed. No retries permitted until 2026-06-14 15:00:13.755651806 +0000 UTC m=+285.772899314 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls") pod "dns-default-s5vxz" (UID: "3235f6e0-17e1-4ecc-93f0-31c4643c9d94") : secret "dns-default-metrics-tls" not found Jun 14 14:58:19.389102 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:19.389018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:58:54.049271 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.049234 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nqmjr"] Jun 14 14:58:54.051132 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.051113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.058689 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.058668 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 14:58:54.060275 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.060260 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 14:58:54.060430 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.060415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m8csd\"" Jun 14 14:58:54.082419 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.082392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:58:54.083987 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.083973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.094943 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.094921 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 14:58:54.095150 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.095137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvf4d\"" Jun 14 14:58:54.097407 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.097316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 14:58:54.097528 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.097404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 14:58:54.098243 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.098224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nqmjr"] Jun 14 14:58:54.102313 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.102297 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 14:58:54.116667 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.115620 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.141847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.141906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.141935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb568\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.141969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.141995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142025 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142440 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142440 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142440 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.142440 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.142642 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.142477 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb"] Jun 14 14:58:54.144203 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.144184 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p2b9z"] Jun 14 14:58:54.144322 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.144296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.145610 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.145594 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq"] Jun 14 14:58:54.145738 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.145723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.146629 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.146610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 14:58:54.146698 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.146616 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.146794 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.146778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tj6q4\"" Jun 14 14:58:54.147029 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.146989 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2"] Jun 14 14:58:54.147153 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.147094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.147153 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.147142 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.147297 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.147215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 14:58:54.147965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.147926 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.147965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.147951 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.148206 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.148192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 14:58:54.148309 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.148291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cb5n6\"" Jun 14 14:58:54.148389 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.148374 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 14:58:54.148703 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.148688 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.150213 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.150197 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 14:58:54.150372 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.150228 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 14:58:54.150529 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.150515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fghcg\"" Jun 14 14:58:54.150578 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.150549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.150659 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.150645 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.151366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.151350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.151439 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.151352 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 14:58:54.153687 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.153668 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 14:58:54.153687 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.153698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.154119 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.154104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ffcqr\"" Jun 14 14:58:54.157009 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.156988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 14:58:54.158250 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.158230 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb"] Jun 14 14:58:54.159165 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.159145 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq"] Jun 14 14:58:54.160339 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.160319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2"] Jun 14 14:58:54.161232 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.161214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p2b9z"] Jun 14 14:58:54.231804 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.231771 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6"] Jun 14 14:58:54.233495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.233480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" Jun 14 14:58:54.236208 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.236193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.236208 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.236201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6fbv2\"" Jun 14 14:58:54.236364 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.236344 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.242398 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.242486 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.242486 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31733dd6-33fb-44bd-8662-3359ce9e7414-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.242486 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.242589 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.242508 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:58:54.242589 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.242520 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dd864cbb-769zt: secret "image-registry-tls" not found Jun 14 14:58:54.242589 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxj7r\" (UniqueName: \"kubernetes.io/projected/31733dd6-33fb-44bd-8662-3359ce9e7414-kube-api-access-lxj7r\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.242589 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.242554 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:58:54.242589 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.242561 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls podName:207ae66c-d798-4d00-ae63-ca81cc1798f4 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.742544369 +0000 UTC m=+206.759791882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls") pod "image-registry-67dd864cbb-769zt" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4") : secret "image-registry-tls" not found Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.242610 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.742597629 +0000 UTC m=+206.759845128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/52e26d83-2f81-44da-9a19-829e2c75a066-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/501e576f-0e7b-4f44-bf07-548b6f693b63-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qj6f\" (UniqueName: \"kubernetes.io/projected/6c3dce43-c768-4895-b6d4-1a329369ee38-kube-api-access-4qj6f\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.242783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/501e576f-0e7b-4f44-bf07-548b6f693b63-config\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3dce43-c768-4895-b6d4-1a329369ee38-serving-cert\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.242989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb568\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243055 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kc9w\" (UniqueName: \"kubernetes.io/projected/bdb4d705-d48a-44a4-ba28-b6fe21376c33-kube-api-access-2kc9w\") pod \"volume-data-source-validator-bd4ccd799-5dbk6\" (UID: \"bdb4d705-d48a-44a4-ba28-b6fe21376c33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5bk\" (UniqueName: \"kubernetes.io/projected/501e576f-0e7b-4f44-bf07-548b6f693b63-kube-api-access-cs5bk\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31733dd6-33fb-44bd-8662-3359ce9e7414-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-tmp\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/52e26d83-2f81-44da-9a19-829e2c75a066-kube-api-access-jfsbl\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.243336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243707 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-snapshots\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.243707 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.243990 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.243937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.244124 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.244104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.245261 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.245238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.245492 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.245475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.245686 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.245660 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6"] Jun 14 14:58:54.259358 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.259329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.259466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.259372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb568\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.343813 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/501e576f-0e7b-4f44-bf07-548b6f693b63-config\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.343959 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3dce43-c768-4895-b6d4-1a329369ee38-serving-cert\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.343959 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.343959 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kc9w\" (UniqueName: \"kubernetes.io/projected/bdb4d705-d48a-44a4-ba28-b6fe21376c33-kube-api-access-2kc9w\") pod \"volume-data-source-validator-bd4ccd799-5dbk6\" (UID: \"bdb4d705-d48a-44a4-ba28-b6fe21376c33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" Jun 14 14:58:54.344075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5bk\" (UniqueName: \"kubernetes.io/projected/501e576f-0e7b-4f44-bf07-548b6f693b63-kube-api-access-cs5bk\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.344075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.343994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31733dd6-33fb-44bd-8662-3359ce9e7414-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.344075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.344075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-tmp\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.344299 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/52e26d83-2f81-44da-9a19-829e2c75a066-kube-api-access-jfsbl\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.344361 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-snapshots\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.344414 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.344414 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31733dd6-33fb-44bd-8662-3359ce9e7414-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.344512 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxj7r\" (UniqueName: \"kubernetes.io/projected/31733dd6-33fb-44bd-8662-3359ce9e7414-kube-api-access-lxj7r\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.344512 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344479 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/501e576f-0e7b-4f44-bf07-548b6f693b63-config\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.344512 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-tmp\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.344512 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/52e26d83-2f81-44da-9a19-829e2c75a066-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.344708 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/501e576f-0e7b-4f44-bf07-548b6f693b63-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.344708 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.344579 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:54.344708 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/31733dd6-33fb-44bd-8662-3359ce9e7414-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.344708 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.344644 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.844629185 +0000 UTC m=+206.861876684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:54.344968 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qj6f\" (UniqueName: \"kubernetes.io/projected/6c3dce43-c768-4895-b6d4-1a329369ee38-kube-api-access-4qj6f\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.344968 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.344964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.345121 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.345096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6c3dce43-c768-4895-b6d4-1a329369ee38-snapshots\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.345296 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.345270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/52e26d83-2f81-44da-9a19-829e2c75a066-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.345412 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.345355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3dce43-c768-4895-b6d4-1a329369ee38-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.346443 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.346423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3dce43-c768-4895-b6d4-1a329369ee38-serving-cert\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.347058 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.347038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/501e576f-0e7b-4f44-bf07-548b6f693b63-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.347135 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.347074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/31733dd6-33fb-44bd-8662-3359ce9e7414-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.353298 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.353261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxj7r\" (UniqueName: \"kubernetes.io/projected/31733dd6-33fb-44bd-8662-3359ce9e7414-kube-api-access-lxj7r\") pod \"kube-storage-version-migrator-operator-7c578b78fc-k8pbq\" (UID: \"31733dd6-33fb-44bd-8662-3359ce9e7414\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.353298 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.353290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfsbl\" (UniqueName: \"kubernetes.io/projected/52e26d83-2f81-44da-9a19-829e2c75a066-kube-api-access-jfsbl\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.353481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.353460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5bk\" (UniqueName: \"kubernetes.io/projected/501e576f-0e7b-4f44-bf07-548b6f693b63-kube-api-access-cs5bk\") pod \"service-ca-operator-7ccbfd59dc-gkrrb\" (UID: \"501e576f-0e7b-4f44-bf07-548b6f693b63\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.353525 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.353514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qj6f\" (UniqueName: \"kubernetes.io/projected/6c3dce43-c768-4895-b6d4-1a329369ee38-kube-api-access-4qj6f\") pod \"insights-operator-5bbd86d6bd-p2b9z\" (UID: \"6c3dce43-c768-4895-b6d4-1a329369ee38\") " pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.353563 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.353538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kc9w\" (UniqueName: \"kubernetes.io/projected/bdb4d705-d48a-44a4-ba28-b6fe21376c33-kube-api-access-2kc9w\") pod \"volume-data-source-validator-bd4ccd799-5dbk6\" (UID: \"bdb4d705-d48a-44a4-ba28-b6fe21376c33\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" Jun 14 14:58:54.454797 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.454730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" Jun 14 14:58:54.463213 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.463185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" Jun 14 14:58:54.468903 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.468874 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" Jun 14 14:58:54.541179 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.541148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" Jun 14 14:58:54.599230 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.599165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb"] Jun 14 14:58:54.606043 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:58:54.605718 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501e576f_0e7b_4f44_bf07_548b6f693b63.slice/crio-5790b583900948f106f09e3a398f9df193dafc2938c5679c0d1c052287982965 WatchSource:0}: Error finding container 5790b583900948f106f09e3a398f9df193dafc2938c5679c0d1c052287982965: Status 404 returned error can't find the container with id 5790b583900948f106f09e3a398f9df193dafc2938c5679c0d1c052287982965 Jun 14 14:58:54.626697 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.623947 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-p2b9z"] Jun 14 14:58:54.627613 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:58:54.627580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3dce43_c768_4895_b6d4_1a329369ee38.slice/crio-d4b843b285cad18522bc00e0d0d0917b565e03c7dafb6b1bc789feaf25a5deb6 WatchSource:0}: Error finding container d4b843b285cad18522bc00e0d0d0917b565e03c7dafb6b1bc789feaf25a5deb6: Status 404 returned error can't find the container with id d4b843b285cad18522bc00e0d0d0917b565e03c7dafb6b1bc789feaf25a5deb6 Jun 14 14:58:54.638156 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.638129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq"] Jun 14 14:58:54.643067 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:58:54.643041 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31733dd6_33fb_44bd_8662_3359ce9e7414.slice/crio-32027dd8af7da3cd8f136fb4851b3ba321e28ef9163fa1e221012aaedb62b1fd WatchSource:0}: Error finding container 32027dd8af7da3cd8f136fb4851b3ba321e28ef9163fa1e221012aaedb62b1fd: Status 404 returned error can't find the container with id 32027dd8af7da3cd8f136fb4851b3ba321e28ef9163fa1e221012aaedb62b1fd Jun 14 14:58:54.686783 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.686729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6"] Jun 14 14:58:54.690582 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:58:54.690553 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb4d705_d48a_44a4_ba28_b6fe21376c33.slice/crio-fbb562c214c9680dede17fd86a46d9013e226ea5173b1fd212116e784a5cf08c WatchSource:0}: Error finding container fbb562c214c9680dede17fd86a46d9013e226ea5173b1fd212116e784a5cf08c: Status 404 returned error can't find the container with id fbb562c214c9680dede17fd86a46d9013e226ea5173b1fd212116e784a5cf08c Jun 14 14:58:54.748166 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.748135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:54.748310 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.748180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:54.748310 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.748279 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:58:54.748384 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.748376 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.748361422 +0000 UTC m=+207.765608918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:58:54.748425 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.748282 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:58:54.748425 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.748394 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dd864cbb-769zt: secret "image-registry-tls" not found Jun 14 14:58:54.748483 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.748456 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls podName:207ae66c-d798-4d00-ae63-ca81cc1798f4 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.748441392 +0000 UTC m=+207.765688909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls") pod "image-registry-67dd864cbb-769zt" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4") : secret "image-registry-tls" not found Jun 14 14:58:54.848922 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.848817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:54.849066 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.848964 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:54.849066 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:54.849027 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.849011003 +0000 UTC m=+207.866258498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:54.992015 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.991977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" event={"ID":"bdb4d705-d48a-44a4-ba28-b6fe21376c33","Type":"ContainerStarted","Data":"fbb562c214c9680dede17fd86a46d9013e226ea5173b1fd212116e784a5cf08c"} Jun 14 14:58:54.993026 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.993004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" event={"ID":"31733dd6-33fb-44bd-8662-3359ce9e7414","Type":"ContainerStarted","Data":"32027dd8af7da3cd8f136fb4851b3ba321e28ef9163fa1e221012aaedb62b1fd"} Jun 14 14:58:54.994059 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.994037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" event={"ID":"6c3dce43-c768-4895-b6d4-1a329369ee38","Type":"ContainerStarted","Data":"d4b843b285cad18522bc00e0d0d0917b565e03c7dafb6b1bc789feaf25a5deb6"} Jun 14 14:58:54.994965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:54.994946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" event={"ID":"501e576f-0e7b-4f44-bf07-548b6f693b63","Type":"ContainerStarted","Data":"5790b583900948f106f09e3a398f9df193dafc2938c5679c0d1c052287982965"} Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:55.757530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:55.757599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.757706 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.757729 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dd864cbb-769zt: secret "image-registry-tls" not found Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.757740 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:58:55.757812 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.757812 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls podName:207ae66c-d798-4d00-ae63-ca81cc1798f4 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.757792002 +0000 UTC m=+209.775039502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls") pod "image-registry-67dd864cbb-769zt" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4") : secret "image-registry-tls" not found Jun 14 14:58:55.758515 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.757835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.757823119 +0000 UTC m=+209.775070615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:58:55.859052 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:55.858903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:55.859235 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.859085 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:55.859235 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:55.859161 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.85914236 +0000 UTC m=+209.876389869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:57.006003 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:57.005968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" event={"ID":"bdb4d705-d48a-44a4-ba28-b6fe21376c33","Type":"ContainerStarted","Data":"12859acba16f6da9beef5e9305bdee5ee25839c42d4b58c5529a0eabf36ab174"} Jun 14 14:58:57.020244 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:57.020191 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5dbk6" podStartSLOduration=1.672219126 podStartE2EDuration="3.020174756s" totalImagesPullingTime="1.34795563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:57.019265565 +0000 UTC m=+209.036513084" watchObservedRunningTime="2026-06-14 14:58:57.020174756 +0000 UTC m=+209.037422252" Jun 14 14:58:57.776965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:57.776855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:58:57.776965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:57.776917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:58:57.777202 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.777027 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:58:57.777202 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.777031 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:58:57.777202 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.777058 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dd864cbb-769zt: secret "image-registry-tls" not found Jun 14 14:58:57.777202 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.777083 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.777068184 +0000 UTC m=+213.794315683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:58:57.777202 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.777109 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls podName:207ae66c-d798-4d00-ae63-ca81cc1798f4 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.777090778 +0000 UTC m=+213.794338285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls") pod "image-registry-67dd864cbb-769zt" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4") : secret "image-registry-tls" not found Jun 14 14:58:57.877537 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:57.877504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:58:57.877728 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.877682 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:57.877799 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:57.877770 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.877737857 +0000 UTC m=+213.894985362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:58:58.011556 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.011505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" event={"ID":"31733dd6-33fb-44bd-8662-3359ce9e7414","Type":"ContainerStarted","Data":"6fe6995da4a70ebef7e960278b43c5cdd7814455f1dec91871032158083f0831"} Jun 14 14:58:58.013479 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.013451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" event={"ID":"6c3dce43-c768-4895-b6d4-1a329369ee38","Type":"ContainerStarted","Data":"70217ac2d628987c29a8455e2c76523432cfe738ef5fd5dfab441259c89016fe"} Jun 14 14:58:58.015020 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.014991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" event={"ID":"501e576f-0e7b-4f44-bf07-548b6f693b63","Type":"ContainerStarted","Data":"6816e405e5cc076625fd2b84db5089a4e908127fbcc9e6a30f77211ac6b05884"} Jun 14 14:58:58.026573 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.026524 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" podStartSLOduration=1.151134131 podStartE2EDuration="4.026506218s" totalImagesPullingTime="2.875372087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:58.025712538 +0000 UTC m=+210.042960057" watchObservedRunningTime="2026-06-14 14:58:58.026506218 +0000 UTC m=+210.043753734" Jun 14 14:58:58.042905 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.042816 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" podStartSLOduration=1.159960699 podStartE2EDuration="4.042743857s" totalImagesPullingTime="2.882783158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:58.041341753 +0000 UTC m=+210.058589272" watchObservedRunningTime="2026-06-14 14:58:58.042743857 +0000 UTC m=+210.059991375" Jun 14 14:58:58.057051 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.057006 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" podStartSLOduration=1.144694199 podStartE2EDuration="4.056990345s" totalImagesPullingTime="2.912296146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:58.055912231 +0000 UTC m=+210.073159761" watchObservedRunningTime="2026-06-14 14:58:58.056990345 +0000 UTC m=+210.074237862" Jun 14 14:58:58.489027 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.488992 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-92bvs"] Jun 14 14:58:58.491430 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.491402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.493668 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.493645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:58:58.493775 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.493651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkhv5\"" Jun 14 14:58:58.494642 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.494618 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:58:58.504075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.504051 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-92bvs"] Jun 14 14:58:58.585351 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.585292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.585529 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.585357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54gp\" (UniqueName: \"kubernetes.io/projected/c90a75b2-f727-43de-873a-e025e978e27e-kube-api-access-l54gp\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.585529 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.585448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c90a75b2-f727-43de-873a-e025e978e27e-data-volume\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.585529 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.585518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.585681 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.585568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c90a75b2-f727-43de-873a-e025e978e27e-crio-socket\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686447 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c90a75b2-f727-43de-873a-e025e978e27e-crio-socket\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686590 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686590 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c90a75b2-f727-43de-873a-e025e978e27e-crio-socket\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686590 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:58.686573 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:58.686711 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54gp\" (UniqueName: \"kubernetes.io/projected/c90a75b2-f727-43de-873a-e025e978e27e-kube-api-access-l54gp\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686711 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:58.686669 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.1866475 +0000 UTC m=+211.203895001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : configmap "kube-rbac-proxy" not found Jun 14 14:58:58.686804 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c90a75b2-f727-43de-873a-e025e978e27e-data-volume\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686847 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.686832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.686993 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:58.686981 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.687047 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:58.687026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.187014344 +0000 UTC m=+211.204261847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.687128 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.687113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c90a75b2-f727-43de-873a-e025e978e27e-data-volume\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:58.696835 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:58.696806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54gp\" (UniqueName: \"kubernetes.io/projected/c90a75b2-f727-43de-873a-e025e978e27e-kube-api-access-l54gp\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:59.191677 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:59.191632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:59.192104 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:58:59.191730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:58:59.192104 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:59.191802 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.192104 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:59.191840 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:59.192104 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:59.191876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.191861801 +0000 UTC m=+212.209109302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.192104 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:58:59.191900 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.191883349 +0000 UTC m=+212.209130853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : configmap "kube-rbac-proxy" not found Jun 14 14:59:00.199051 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:00.199011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:00.199475 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:00.199122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:00.199475 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:00.199133 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:00.199475 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:00.199193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.199179429 +0000 UTC m=+214.216426926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : configmap "kube-rbac-proxy" not found Jun 14 14:59:00.199475 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:00.199262 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.199475 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:00.199314 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.199302462 +0000 UTC m=+214.216549958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.364233 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:00.364207 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-88562_2ef30188-47a8-43ae-9ec9-411f7998c2d0/dns-node-resolver/0.log" Jun 14 14:59:01.332607 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.332574 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-wzjm6"] Jun 14 14:59:01.334576 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.334560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.337122 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.337098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 14:59:01.337238 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.337105 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 14:59:01.338190 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.338165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 14:59:01.338302 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.338216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6xmhc\"" Jun 14 14:59:01.338302 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.338263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 14:59:01.344291 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.344264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-wzjm6"] Jun 14 14:59:01.409598 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.409558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-key\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.409598 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.409598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-cabundle\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.409838 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.409697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7f48\" (UniqueName: \"kubernetes.io/projected/cb31def9-f6d4-4b09-b178-033e063cb60d-kube-api-access-t7f48\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.510413 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.510374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7f48\" (UniqueName: \"kubernetes.io/projected/cb31def9-f6d4-4b09-b178-033e063cb60d-kube-api-access-t7f48\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.510586 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.510471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-key\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.510586 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.510497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-cabundle\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.511239 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.511213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-cabundle\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.512821 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.512793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cb31def9-f6d4-4b09-b178-033e063cb60d-signing-key\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.519963 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.519942 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7f48\" (UniqueName: \"kubernetes.io/projected/cb31def9-f6d4-4b09-b178-033e063cb60d-kube-api-access-t7f48\") pod \"service-ca-7b994bc59-wzjm6\" (UID: \"cb31def9-f6d4-4b09-b178-033e063cb60d\") " pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.563127 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.563099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqkws_317cfac5-b421-41f2-bfa1-f4b165180a51/node-ca/0.log" Jun 14 14:59:01.648497 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.648402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" Jun 14 14:59:01.770959 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.770935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-wzjm6"] Jun 14 14:59:01.773211 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:01.773189 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb31def9_f6d4_4b09_b178_033e063cb60d.slice/crio-1eac3eaad56ad84e210a02e4a34b9587858ed2869129186d6da510c2b85f667f WatchSource:0}: Error finding container 1eac3eaad56ad84e210a02e4a34b9587858ed2869129186d6da510c2b85f667f: Status 404 returned error can't find the container with id 1eac3eaad56ad84e210a02e4a34b9587858ed2869129186d6da510c2b85f667f Jun 14 14:59:01.813692 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.813668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:01.813814 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.813720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:59:01.813857 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.813835 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:59:01.813891 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.813858 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dd864cbb-769zt: secret "image-registry-tls" not found Jun 14 14:59:01.813937 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.813909 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls podName:207ae66c-d798-4d00-ae63-ca81cc1798f4 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.813893438 +0000 UTC m=+221.831140946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls") pod "image-registry-67dd864cbb-769zt" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4") : secret "image-registry-tls" not found Jun 14 14:59:01.813937 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.813833 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:59:01.814018 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.813979 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.813966209 +0000 UTC m=+221.831213705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:59:01.914636 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:01.914549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:59:01.914961 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.914697 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:59:01.914961 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:01.914780 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.914745555 +0000 UTC m=+221.931993052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:59:02.029092 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.029059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" event={"ID":"cb31def9-f6d4-4b09-b178-033e063cb60d","Type":"ContainerStarted","Data":"f4252b6035148e0fd961ea45445747c6d345c7f15c72b3a66a41296b3cfc9425"} Jun 14 14:59:02.029260 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.029116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" event={"ID":"cb31def9-f6d4-4b09-b178-033e063cb60d","Type":"ContainerStarted","Data":"1eac3eaad56ad84e210a02e4a34b9587858ed2869129186d6da510c2b85f667f"} Jun 14 14:59:02.049024 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.048978 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-wzjm6" podStartSLOduration=1.0489624 podStartE2EDuration="1.0489624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:02.048104899 +0000 UTC m=+214.065352472" watchObservedRunningTime="2026-06-14 14:59:02.0489624 +0000 UTC m=+214.066209917" Jun 14 14:59:02.218263 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.218234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:02.218415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.218302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:02.218415 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:02.218368 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:02.218415 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:02.218393 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.218552 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:02.218444 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.218429445 +0000 UTC m=+218.235676945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : configmap "kube-rbac-proxy" not found Jun 14 14:59:02.218552 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:02.218460 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.21845419 +0000 UTC m=+218.235701685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.564328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:02.564248 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlpxm_33b5b70f-f79c-4a8e-9990-9708adad8f45/serve-healthcheck-canary/0.log" Jun 14 14:59:06.253707 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:06.253676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:06.254149 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:06.253790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:06.254149 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:06.253820 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:06.254149 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:06.253879 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.253861359 +0000 UTC m=+226.271108864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : configmap "kube-rbac-proxy" not found Jun 14 14:59:06.254149 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:06.253963 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:06.254149 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:06.254025 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls podName:c90a75b2-f727-43de-873a-e025e978e27e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.25400875 +0000 UTC m=+226.271256249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92bvs" (UID: "c90a75b2-f727-43de-873a-e025e978e27e") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:09.885673 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:09.885630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:09.886097 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:09.885690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:59:09.886097 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:09.885842 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:59:09.886097 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:09.885918 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert podName:1db4ce8a-66a6-4b50-bb11-a7ab493d8861 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:25.885901442 +0000 UTC m=+237.903148938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nqmjr" (UID: "1db4ce8a-66a6-4b50-bb11-a7ab493d8861") : secret "networking-console-plugin-cert" not found Jun 14 14:59:09.888086 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:09.888061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"image-registry-67dd864cbb-769zt\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:09.986232 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:09.986197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:59:09.986403 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:09.986347 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:59:09.986443 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:09.986412 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls podName:52e26d83-2f81-44da-9a19-829e2c75a066 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:25.986397467 +0000 UTC m=+238.003644963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d2md2" (UID: "52e26d83-2f81-44da-9a19-829e2c75a066") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:59:09.992247 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:09.992224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:10.115183 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:10.115150 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:59:10.118372 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:10.118344 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207ae66c_d798_4d00_ae63_ca81cc1798f4.slice/crio-818b9109dbdce1f1bce639587b02b69b2211cfb7f09e1387358ce1949ed55c79 WatchSource:0}: Error finding container 818b9109dbdce1f1bce639587b02b69b2211cfb7f09e1387358ce1949ed55c79: Status 404 returned error can't find the container with id 818b9109dbdce1f1bce639587b02b69b2211cfb7f09e1387358ce1949ed55c79 Jun 14 14:59:11.059649 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:11.059618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" event={"ID":"207ae66c-d798-4d00-ae63-ca81cc1798f4","Type":"ContainerStarted","Data":"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184"} Jun 14 14:59:11.060031 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:11.059662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" event={"ID":"207ae66c-d798-4d00-ae63-ca81cc1798f4","Type":"ContainerStarted","Data":"818b9109dbdce1f1bce639587b02b69b2211cfb7f09e1387358ce1949ed55c79"} Jun 14 14:59:11.060031 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:11.059741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:11.078294 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:11.078246 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" podStartSLOduration=17.07822996 podStartE2EDuration="17.07822996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:11.077601266 +0000 UTC m=+223.094848800" watchObservedRunningTime="2026-06-14 14:59:11.07822996 +0000 UTC m=+223.095477479" Jun 14 14:59:14.320258 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.320220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:14.320654 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.320283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:14.320724 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.320708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c90a75b2-f727-43de-873a-e025e978e27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:14.322532 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.322496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c90a75b2-f727-43de-873a-e025e978e27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92bvs\" (UID: \"c90a75b2-f727-43de-873a-e025e978e27e\") " pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:14.401846 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.401817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-92bvs" Jun 14 14:59:14.527196 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:14.527033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-92bvs"] Jun 14 14:59:14.529798 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:14.529745 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90a75b2_f727_43de_873a_e025e978e27e.slice/crio-188b9babd2391aac1e7ad4dffa76a8d2b6e0eb3bf910fe874bb67729dcc7aa81 WatchSource:0}: Error finding container 188b9babd2391aac1e7ad4dffa76a8d2b6e0eb3bf910fe874bb67729dcc7aa81: Status 404 returned error can't find the container with id 188b9babd2391aac1e7ad4dffa76a8d2b6e0eb3bf910fe874bb67729dcc7aa81 Jun 14 14:59:15.077336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:15.077249 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92bvs" event={"ID":"c90a75b2-f727-43de-873a-e025e978e27e","Type":"ContainerStarted","Data":"188b9babd2391aac1e7ad4dffa76a8d2b6e0eb3bf910fe874bb67729dcc7aa81"} Jun 14 14:59:18.088924 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:18.088892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92bvs" event={"ID":"c90a75b2-f727-43de-873a-e025e978e27e","Type":"ContainerStarted","Data":"44e100da515043c670dc23be67fad9b0fe60c4b0386620417ab7a9caa7abaf26"} Jun 14 14:59:19.093911 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:19.093859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92bvs" event={"ID":"c90a75b2-f727-43de-873a-e025e978e27e","Type":"ContainerStarted","Data":"21be791fc4f8504dc62c2715f8133ba38038e8e1442175457742800319ed711b"} Jun 14 14:59:20.652259 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.652180 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:59:20.686171 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.686137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7645cd7dfb-f2hj6"] Jun 14 14:59:20.689337 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.689317 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.700997 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.700978 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7645cd7dfb-f2hj6"] Jun 14 14:59:20.774807 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-installation-pull-secrets\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.774975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-bound-sa-token\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.774975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-image-registry-private-configuration\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.774975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-registry-certificates\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.774975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-registry-tls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.774975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/591befad-2872-424b-aeb4-f69b25a10948-ca-trust-extracted\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.775140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.774977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-trusted-ca\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.775140 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.775015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxgls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-kube-api-access-hxgls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875423 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-installation-pull-secrets\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875423 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-bound-sa-token\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875658 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-image-registry-private-configuration\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875658 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-registry-certificates\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875796 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-registry-tls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875796 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/591befad-2872-424b-aeb4-f69b25a10948-ca-trust-extracted\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875796 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-trusted-ca\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.875796 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.875787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxgls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-kube-api-access-hxgls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.876457 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.876423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/591befad-2872-424b-aeb4-f69b25a10948-ca-trust-extracted\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.876698 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.876676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-trusted-ca\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.876741 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.876709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/591befad-2872-424b-aeb4-f69b25a10948-registry-certificates\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.877995 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.877973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-image-registry-private-configuration\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.878304 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.878290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/591befad-2872-424b-aeb4-f69b25a10948-installation-pull-secrets\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.878409 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.878391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-registry-tls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.886159 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.886140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-bound-sa-token\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.886445 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.886421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxgls\" (UniqueName: \"kubernetes.io/projected/591befad-2872-424b-aeb4-f69b25a10948-kube-api-access-hxgls\") pod \"image-registry-7645cd7dfb-f2hj6\" (UID: \"591befad-2872-424b-aeb4-f69b25a10948\") " pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:20.997376 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:20.997347 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:21.102962 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:21.102932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92bvs" event={"ID":"c90a75b2-f727-43de-873a-e025e978e27e","Type":"ContainerStarted","Data":"080c596d7026067df6fa633c984d8fd9eb494c69d426d6fb1e190dcdb014a43f"} Jun 14 14:59:21.120472 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:21.120422 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-92bvs" podStartSLOduration=17.461573851 podStartE2EDuration="23.120407511s" totalImagesPullingTime="5.65883366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:58:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:21.119091607 +0000 UTC m=+233.136339125" watchObservedRunningTime="2026-06-14 14:59:21.120407511 +0000 UTC m=+233.137655029" Jun 14 14:59:21.124508 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:21.124478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7645cd7dfb-f2hj6"] Jun 14 14:59:21.127215 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:21.127192 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591befad_2872_424b_aeb4_f69b25a10948.slice/crio-5fce08639502863c18872205f55ad7eeb1949daebcdc660cfbc93a9b1b2966be WatchSource:0}: Error finding container 5fce08639502863c18872205f55ad7eeb1949daebcdc660cfbc93a9b1b2966be: Status 404 returned error can't find the container with id 5fce08639502863c18872205f55ad7eeb1949daebcdc660cfbc93a9b1b2966be Jun 14 14:59:22.108151 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:22.108112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" event={"ID":"591befad-2872-424b-aeb4-f69b25a10948","Type":"ContainerStarted","Data":"b2abbff381213319349634fc05f4b740f4101e9c70147e59764731877b7aac8a"} Jun 14 14:59:22.108620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:22.108165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" event={"ID":"591befad-2872-424b-aeb4-f69b25a10948","Type":"ContainerStarted","Data":"5fce08639502863c18872205f55ad7eeb1949daebcdc660cfbc93a9b1b2966be"} Jun 14 14:59:22.108620 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:22.108347 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 14:59:22.127984 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:22.127934 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podStartSLOduration=2.127919391 podStartE2EDuration="2.127919391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:22.127244069 +0000 UTC m=+234.144491601" watchObservedRunningTime="2026-06-14 14:59:22.127919391 +0000 UTC m=+234.145166973" Jun 14 14:59:25.917314 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:25.917278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:59:25.919622 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:25.919591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1db4ce8a-66a6-4b50-bb11-a7ab493d8861-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nqmjr\" (UID: \"1db4ce8a-66a6-4b50-bb11-a7ab493d8861\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:59:26.018112 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.018060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:59:26.020391 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.020370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/52e26d83-2f81-44da-9a19-829e2c75a066-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d2md2\" (UID: \"52e26d83-2f81-44da-9a19-829e2c75a066\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:59:26.159558 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.159518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" Jun 14 14:59:26.274146 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.274116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" Jun 14 14:59:26.302686 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.302657 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nqmjr"] Jun 14 14:59:26.305561 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:26.305532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db4ce8a_66a6_4b50_bb11_a7ab493d8861.slice/crio-5b6225063e397b1a714f1f3977b2588e95c41b37f9410251a3480bd4886cd4bc WatchSource:0}: Error finding container 5b6225063e397b1a714f1f3977b2588e95c41b37f9410251a3480bd4886cd4bc: Status 404 returned error can't find the container with id 5b6225063e397b1a714f1f3977b2588e95c41b37f9410251a3480bd4886cd4bc Jun 14 14:59:26.394743 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:26.394722 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2"] Jun 14 14:59:26.397299 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:26.397265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e26d83_2f81_44da_9a19_829e2c75a066.slice/crio-22fd2f315504c56c92c7c688a85843b1e2b914ad9a0cd734a8d3667b54a2f6ec WatchSource:0}: Error finding container 22fd2f315504c56c92c7c688a85843b1e2b914ad9a0cd734a8d3667b54a2f6ec: Status 404 returned error can't find the container with id 22fd2f315504c56c92c7c688a85843b1e2b914ad9a0cd734a8d3667b54a2f6ec Jun 14 14:59:27.125088 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:27.125015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" event={"ID":"1db4ce8a-66a6-4b50-bb11-a7ab493d8861","Type":"ContainerStarted","Data":"5b6225063e397b1a714f1f3977b2588e95c41b37f9410251a3480bd4886cd4bc"} Jun 14 14:59:27.126302 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:27.126255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" event={"ID":"52e26d83-2f81-44da-9a19-829e2c75a066","Type":"ContainerStarted","Data":"22fd2f315504c56c92c7c688a85843b1e2b914ad9a0cd734a8d3667b54a2f6ec"} Jun 14 14:59:28.131545 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:28.131512 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" event={"ID":"1db4ce8a-66a6-4b50-bb11-a7ab493d8861","Type":"ContainerStarted","Data":"78acd42148fd318ae9fb9c2475da02ee2965ad670d462da4f0df370239e84cf9"} Jun 14 14:59:28.133193 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:28.133167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" event={"ID":"52e26d83-2f81-44da-9a19-829e2c75a066","Type":"ContainerStarted","Data":"813cfefcfe25e90a50292f6ca6118203f02ef7785a0aee6540a211f4120f51a8"} Jun 14 14:59:28.145965 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:28.145916 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-nqmjr" podStartSLOduration=32.452236355 podStartE2EDuration="34.145900625s" totalImagesPullingTime="1.69366427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:28.1454947 +0000 UTC m=+240.162742238" watchObservedRunningTime="2026-06-14 14:59:28.145900625 +0000 UTC m=+240.163148169" Jun 14 14:59:28.160040 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:28.159986 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d2md2" podStartSLOduration=32.554149527 podStartE2EDuration="34.15996721s" totalImagesPullingTime="1.605817683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:28.159214814 +0000 UTC m=+240.176462384" watchObservedRunningTime="2026-06-14 14:59:28.15996721 +0000 UTC m=+240.177214728" Jun 14 14:59:30.657562 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:30.657525 2577 patch_prober.go:28] interesting pod/image-registry-67dd864cbb-769zt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:30.657984 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:30.657586 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:32.912564 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:32.912522 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 14:59:33.031525 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.031483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 14:59:33.031684 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.031611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.034597 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.034574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 14:59:33.034597 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.034576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jr9b7\"" Jun 14 14:59:33.034781 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.034631 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:59:33.035362 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.035337 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 14:59:33.035487 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.035415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 14:59:33.035487 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.035424 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 14:59:33.035487 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.035463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:59:33.035657 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.035416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 14:59:33.040991 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.040969 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 14:59:33.178146 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178146 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178146 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xtx7\" (UniqueName: \"kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.178366 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.178217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.278859 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.278829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.278859 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.278865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.278883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.278901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.278969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279094 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xtx7\" (UniqueName: \"kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279660 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279796 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279662 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279854 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.279854 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.279807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.281767 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.281739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.281888 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.281869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.287355 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.287330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xtx7\" (UniqueName: \"kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7\") pod \"console-7cb9d48b86-l9jwn\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.341416 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.341386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:33.511331 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:33.511303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 14:59:33.513991 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:33.513956 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda938d1c_006f_4149_885c_0a653f5a3911.slice/crio-10ae95167c76076c15e2faad517c3ead7e4811f1456c3b580e5fed4d537fce0c WatchSource:0}: Error finding container 10ae95167c76076c15e2faad517c3ead7e4811f1456c3b580e5fed4d537fce0c: Status 404 returned error can't find the container with id 10ae95167c76076c15e2faad517c3ead7e4811f1456c3b580e5fed4d537fce0c Jun 14 14:59:34.154295 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:34.154255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb9d48b86-l9jwn" event={"ID":"da938d1c-006f-4149-885c-0a653f5a3911","Type":"ContainerStarted","Data":"10ae95167c76076c15e2faad517c3ead7e4811f1456c3b580e5fed4d537fce0c"} Jun 14 14:59:37.167301 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:37.167264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb9d48b86-l9jwn" event={"ID":"da938d1c-006f-4149-885c-0a653f5a3911","Type":"ContainerStarted","Data":"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e"} Jun 14 14:59:37.192770 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:37.192707 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb9d48b86-l9jwn" podStartSLOduration=2.005962059 podStartE2EDuration="5.192691132s" totalImagesPullingTime="3.186729073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:37.19217647 +0000 UTC m=+249.209423988" watchObservedRunningTime="2026-06-14 14:59:37.192691132 +0000 UTC m=+249.209938650" Jun 14 14:59:40.234282 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.234245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:59:40.236519 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.236499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a1b6bc7-df6a-455f-9fac-140299fd2ce2-metrics-certs\") pod \"network-metrics-daemon-vdgxn\" (UID: \"5a1b6bc7-df6a-455f-9fac-140299fd2ce2\") " pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:59:40.392413 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.392385 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 14:59:40.400603 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.400583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdgxn" Jun 14 14:59:40.525077 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.525050 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdgxn"] Jun 14 14:59:40.527309 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:40.527278 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1b6bc7_df6a_455f_9fac_140299fd2ce2.slice/crio-5091145f21769fba91d7445ab569b20cf37cc372b4cb6c7d52aea73addd6bd62 WatchSource:0}: Error finding container 5091145f21769fba91d7445ab569b20cf37cc372b4cb6c7d52aea73addd6bd62: Status 404 returned error can't find the container with id 5091145f21769fba91d7445ab569b20cf37cc372b4cb6c7d52aea73addd6bd62 Jun 14 14:59:40.656850 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.656818 2577 patch_prober.go:28] interesting pod/image-registry-67dd864cbb-769zt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:40.657012 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:40.656880 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:41.001680 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:41.001652 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:41.001848 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:41.001700 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:41.182304 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:41.182263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdgxn" event={"ID":"5a1b6bc7-df6a-455f-9fac-140299fd2ce2","Type":"ContainerStarted","Data":"5091145f21769fba91d7445ab569b20cf37cc372b4cb6c7d52aea73addd6bd62"} Jun 14 14:59:42.187689 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:42.187658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdgxn" event={"ID":"5a1b6bc7-df6a-455f-9fac-140299fd2ce2","Type":"ContainerStarted","Data":"e7f6f27eb66ceacb677ad03873df2c94f50db5d671a2f17795f1a3e7e77734ef"} Jun 14 14:59:42.188072 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:42.187710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdgxn" event={"ID":"5a1b6bc7-df6a-455f-9fac-140299fd2ce2","Type":"ContainerStarted","Data":"362baef117fcaf18f3f4845f4e35b5fbac2a060e612ae41efe976c3210442ce0"} Jun 14 14:59:42.206407 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:42.206364 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdgxn" podStartSLOduration=253.192249961 podStartE2EDuration="4m14.206349322s" totalImagesPullingTime="1.014099361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:42.205824255 +0000 UTC m=+254.223071774" watchObservedRunningTime="2026-06-14 14:59:42.206349322 +0000 UTC m=+254.223596840" Jun 14 14:59:43.115547 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.115506 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:43.115737 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.115560 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:43.341627 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.341590 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:43.342044 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.341648 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 14:59:43.343215 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.343189 2577 patch_prober.go:28] interesting pod/console-7cb9d48b86-l9jwn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 14 14:59:43.343316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:43.343233 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7cb9d48b86-l9jwn" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 14 14:59:44.908897 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.908856 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr"] Jun 14 14:59:44.911014 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.910992 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:44.913656 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.913632 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 14:59:44.913935 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.913739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mcfv\"" Jun 14 14:59:44.913935 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.913781 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:59:44.913935 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.913789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 14:59:44.926039 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.926013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr"] Jun 14 14:59:44.928928 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.928902 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc"] Jun 14 14:59:44.931221 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.931202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:44.933988 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.933738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 14:59:44.935316 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.935288 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 14:59:44.935412 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.935346 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6w7lt\"" Jun 14 14:59:44.935605 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.935586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 14:59:44.935694 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.935627 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f7wd4"] Jun 14 14:59:44.937661 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.937642 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:44.940182 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.940165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:59:44.940266 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.940165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:59:44.940266 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.940181 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m7rxh\"" Jun 14 14:59:44.940380 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.940202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:59:44.944697 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:44.944669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc"] Jun 14 14:59:45.072617 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.072617 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-tls\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5z28\" (UniqueName: \"kubernetes.io/projected/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-api-access-l5z28\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-sys\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.072887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-root\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-textfile\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-metrics-client-ca\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.072957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81eb82c7-dd13-40d6-a323-304272d37a7f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.073184 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2a66eb-b134-493a-a8c5-115edc0cb60a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.073495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-wtmp\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.073495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jwbx\" (UniqueName: \"kubernetes.io/projected/da2a66eb-b134-493a-a8c5-115edc0cb60a-kube-api-access-4jwbx\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.073495 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.073299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c796n\" (UniqueName: \"kubernetes.io/projected/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-kube-api-access-c796n\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.174753 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.174753 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.174753 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2a66eb-b134-493a-a8c5-115edc0cb60a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.174753 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-wtmp\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175106 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwbx\" (UniqueName: \"kubernetes.io/projected/da2a66eb-b134-493a-a8c5-115edc0cb60a-kube-api-access-4jwbx\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.175106 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.174979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-wtmp\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175201 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c796n\" (UniqueName: \"kubernetes.io/projected/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-kube-api-access-c796n\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175201 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175201 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-tls\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5z28\" (UniqueName: \"kubernetes.io/projected/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-api-access-l5z28\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-sys\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.175466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-root\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175466 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-textfile\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-metrics-client-ca\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175570 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da2a66eb-b134-493a-a8c5-115edc0cb60a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.175780 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175780 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81eb82c7-dd13-40d6-a323-304272d37a7f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.175780 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-root\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175943 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-textfile\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.175998 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.175966 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81eb82c7-dd13-40d6-a323-304272d37a7f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.176131 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-metrics-client-ca\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.176183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81eb82c7-dd13-40d6-a323-304272d37a7f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.176207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-sys\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:45.176223 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:45.176289 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls podName:da2a66eb-b134-493a-a8c5-115edc0cb60a nodeName:}" failed. No retries permitted until 2026-06-14 14:59:45.676270462 +0000 UTC m=+257.693517977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-69kzr" (UID: "da2a66eb-b134-493a-a8c5-115edc0cb60a") : secret "openshift-state-metrics-tls" not found Jun 14 14:59:45.176611 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.176566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.178070 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.178048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.178181 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.178110 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.178468 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.178434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.178635 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.178617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-node-exporter-tls\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.178933 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.178916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.183304 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.183287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jwbx\" (UniqueName: \"kubernetes.io/projected/da2a66eb-b134-493a-a8c5-115edc0cb60a-kube-api-access-4jwbx\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.183624 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.183608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5z28\" (UniqueName: \"kubernetes.io/projected/81eb82c7-dd13-40d6-a323-304272d37a7f-kube-api-access-l5z28\") pod \"kube-state-metrics-678bc549d7-8kjkc\" (UID: \"81eb82c7-dd13-40d6-a323-304272d37a7f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.184275 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.184259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c796n\" (UniqueName: \"kubernetes.io/projected/94edfd2d-f4f0-4240-ac13-bd2d0cfd4463-kube-api-access-c796n\") pod \"node-exporter-f7wd4\" (UID: \"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463\") " pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.242745 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.242706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" Jun 14 14:59:45.250470 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.250444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7wd4" Jun 14 14:59:45.261405 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:45.261376 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94edfd2d_f4f0_4240_ac13_bd2d0cfd4463.slice/crio-d5f731f48981afd4df0932b425e95608aaa0e7887350f9671f9b6b8a5224b6b1 WatchSource:0}: Error finding container d5f731f48981afd4df0932b425e95608aaa0e7887350f9671f9b6b8a5224b6b1: Status 404 returned error can't find the container with id d5f731f48981afd4df0932b425e95608aaa0e7887350f9671f9b6b8a5224b6b1 Jun 14 14:59:45.385211 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.385182 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc"] Jun 14 14:59:45.388202 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:45.388172 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81eb82c7_dd13_40d6_a323_304272d37a7f.slice/crio-101b31ff2391dc7c68304e88893a1bc31cef596039f17678d228941c03174553 WatchSource:0}: Error finding container 101b31ff2391dc7c68304e88893a1bc31cef596039f17678d228941c03174553: Status 404 returned error can't find the container with id 101b31ff2391dc7c68304e88893a1bc31cef596039f17678d228941c03174553 Jun 14 14:59:45.671739 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.671699 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" containerID="cri-o://431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184" gracePeriod=30 Jun 14 14:59:45.680499 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.680475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.682697 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.682674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da2a66eb-b134-493a-a8c5-115edc0cb60a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-69kzr\" (UID: \"da2a66eb-b134-493a-a8c5-115edc0cb60a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.821772 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.821734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" Jun 14 14:59:45.934112 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.934071 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:45.996481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.996395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr"] Jun 14 14:59:45.999224 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.999186 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:59:45.999606 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.999589 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" Jun 14 14:59:45.999708 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.999609 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" Jun 14 14:59:45.999708 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:45.999676 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerName="registry" Jun 14 14:59:46.000595 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:46.000557 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2a66eb_b134_493a_a8c5_115edc0cb60a.slice/crio-0969f061575e78a8622a81135e143f59f9128b236e92e753c1cb9ffe2946ed25 WatchSource:0}: Error finding container 0969f061575e78a8622a81135e143f59f9128b236e92e753c1cb9ffe2946ed25: Status 404 returned error can't find the container with id 0969f061575e78a8622a81135e143f59f9128b236e92e753c1cb9ffe2946ed25 Jun 14 14:59:46.002797 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.002729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.005488 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.005450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 14:59:46.005488 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.005471 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 14:59:46.005660 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.005637 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 14:59:46.005976 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.005809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 14:59:46.007081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.006230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 14:59:46.007081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.006451 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrlk5\"" Jun 14 14:59:46.007081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.006636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 14:59:46.007081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.006822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 14:59:46.007081 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.006975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 14:59:46.007681 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.007659 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 14:59:46.016351 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.016330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.083923 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084000 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb568\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084070 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084106 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084142 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084139 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084475 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084174 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084475 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084214 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates\") pod \"207ae66c-d798-4d00-ae63-ca81cc1798f4\" (UID: \"207ae66c-d798-4d00-ae63-ca81cc1798f4\") " Jun 14 14:59:46.084873 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084801 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:59:46.084873 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.084805 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:59:46.087595 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.087439 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:59:46.088546 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.088371 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:59:46.088684 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.088647 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:59:46.088840 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.088720 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:59:46.091670 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.091633 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568" (OuterVolumeSpecName: "kube-api-access-sb568") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "kube-api-access-sb568". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:59:46.096891 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.096800 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "207ae66c-d798-4d00-ae63-ca81cc1798f4" (UID: "207ae66c-d798-4d00-ae63-ca81cc1798f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dcjv\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.185995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186101 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-bound-sa-token\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186122 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-certificates\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186137 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/207ae66c-d798-4d00-ae63-ca81cc1798f4-trusted-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.186868 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186152 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-installation-pull-secrets\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.187846 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186166 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb568\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-kube-api-access-sb568\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.187846 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186181 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/207ae66c-d798-4d00-ae63-ca81cc1798f4-image-registry-private-configuration\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.187846 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186196 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/207ae66c-d798-4d00-ae63-ca81cc1798f4-registry-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.187846 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.186211 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/207ae66c-d798-4d00-ae63-ca81cc1798f4-ca-trust-extracted\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 14:59:46.204438 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.204402 2577 generic.go:356] "Generic (PLEG): container finished" podID="207ae66c-d798-4d00-ae63-ca81cc1798f4" containerID="431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184" exitCode=0 Jun 14 14:59:46.204555 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.204492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" event={"ID":"207ae66c-d798-4d00-ae63-ca81cc1798f4","Type":"ContainerDied","Data":"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184"} Jun 14 14:59:46.204555 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.204537 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" event={"ID":"207ae66c-d798-4d00-ae63-ca81cc1798f4","Type":"ContainerDied","Data":"818b9109dbdce1f1bce639587b02b69b2211cfb7f09e1387358ce1949ed55c79"} Jun 14 14:59:46.204665 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.204562 2577 scope.go:117] "RemoveContainer" containerID="431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184" Jun 14 14:59:46.204719 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.204705 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd864cbb-769zt" Jun 14 14:59:46.207686 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.207656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7wd4" event={"ID":"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463","Type":"ContainerStarted","Data":"d5f731f48981afd4df0932b425e95608aaa0e7887350f9671f9b6b8a5224b6b1"} Jun 14 14:59:46.210890 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.210861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" event={"ID":"81eb82c7-dd13-40d6-a323-304272d37a7f","Type":"ContainerStarted","Data":"101b31ff2391dc7c68304e88893a1bc31cef596039f17678d228941c03174553"} Jun 14 14:59:46.212876 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.212851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" event={"ID":"da2a66eb-b134-493a-a8c5-115edc0cb60a","Type":"ContainerStarted","Data":"f2c77d2bdb51dc98b5db08576b66f49c73c31cfdbc3a5ff440179db9b2afe3d1"} Jun 14 14:59:46.212973 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.212907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" event={"ID":"da2a66eb-b134-493a-a8c5-115edc0cb60a","Type":"ContainerStarted","Data":"0969f061575e78a8622a81135e143f59f9128b236e92e753c1cb9ffe2946ed25"} Jun 14 14:59:46.233075 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.233014 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:59:46.235302 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.235283 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67dd864cbb-769zt"] Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dcjv\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.290356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.289597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.291098 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.290531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.291502 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.291167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.296516 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.295810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.296516 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.296052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.296516 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.296261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.296935 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.296889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.297415 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.297389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.297800 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.297779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.299197 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.298962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.299716 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.299670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dcjv\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.301672 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.301150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.301815 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.301791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.302108 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.302084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.318887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.318860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 14:59:46.366720 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.366456 2577 scope.go:117] "RemoveContainer" containerID="431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184" Jun 14 14:59:46.367393 ip-10-0-139-109 kubenswrapper[2577]: E0614 14:59:46.366943 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184\": container with ID starting with 431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184 not found: ID does not exist" containerID="431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184" Jun 14 14:59:46.367393 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.366991 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184"} err="failed to get container status \"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184\": rpc error: code = NotFound desc = could not find container \"431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184\": container with ID starting with 431c53b578839682bd6241a7365ff494f57aba959fe585a20809e4c8db9c4184 not found: ID does not exist" Jun 14 14:59:46.394481 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.394456 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207ae66c-d798-4d00-ae63-ca81cc1798f4" path="/var/lib/kubelet/pods/207ae66c-d798-4d00-ae63-ca81cc1798f4/volumes" Jun 14 14:59:46.882622 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:46.882593 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 14:59:47.220487 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.220447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" event={"ID":"81eb82c7-dd13-40d6-a323-304272d37a7f","Type":"ContainerStarted","Data":"672a987cf67649be102a04bbb8c96defd5f6c6080829b9700c802e3101611779"} Jun 14 14:59:47.220971 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.220517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" event={"ID":"81eb82c7-dd13-40d6-a323-304272d37a7f","Type":"ContainerStarted","Data":"6db891ec83d8a174c207171a5f946d02a93c94219628c86c270dd9ff8d20ac2c"} Jun 14 14:59:47.220971 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.220551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" event={"ID":"81eb82c7-dd13-40d6-a323-304272d37a7f","Type":"ContainerStarted","Data":"ed23741bd3096991a6739e22c90ff27ec8cac060339f36da413e9b0fd12e6754"} Jun 14 14:59:47.223072 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.223031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" event={"ID":"da2a66eb-b134-493a-a8c5-115edc0cb60a","Type":"ContainerStarted","Data":"b4caf2374193a84d922449eccf562162d8037a9dd50802507731f84686842761"} Jun 14 14:59:47.225293 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.225265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"fba567586598647d240fb2792de84eac746dac548d386e7fec728e9422e54c2a"} Jun 14 14:59:47.227102 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.227076 2577 generic.go:356] "Generic (PLEG): container finished" podID="94edfd2d-f4f0-4240-ac13-bd2d0cfd4463" containerID="569aaa44acd8a5e8b98e37220418ec31b1ad5e050cd6e51707438b4b6a48627a" exitCode=0 Jun 14 14:59:47.227217 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.227164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7wd4" event={"ID":"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463","Type":"ContainerDied","Data":"569aaa44acd8a5e8b98e37220418ec31b1ad5e050cd6e51707438b4b6a48627a"} Jun 14 14:59:47.239485 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:47.239437 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8kjkc" podStartSLOduration=1.895867812 podStartE2EDuration="3.239422516s" totalImagesPullingTime="1.343554704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:47.238371648 +0000 UTC m=+259.255619190" watchObservedRunningTime="2026-06-14 14:59:47.239422516 +0000 UTC m=+259.256670033" Jun 14 14:59:48.233183 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.233144 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" event={"ID":"da2a66eb-b134-493a-a8c5-115edc0cb60a","Type":"ContainerStarted","Data":"1856636fa3634e5aa1e4a50210614f2bce0ff38879288e40ebc6bcd0b4bec03a"} Jun 14 14:59:48.234740 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.234704 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41" exitCode=0 Jun 14 14:59:48.234920 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.234799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41"} Jun 14 14:59:48.237334 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.237303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7wd4" event={"ID":"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463","Type":"ContainerStarted","Data":"7b7af3b9a4ca58842acdb5be29ad13cd5ea7a7b1d6599f816ec0167406a2f118"} Jun 14 14:59:48.237460 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.237352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7wd4" event={"ID":"94edfd2d-f4f0-4240-ac13-bd2d0cfd4463","Type":"ContainerStarted","Data":"1de5429586d4e1c6d1740cb95612e64e948b818667f5407659822f766fd70bee"} Jun 14 14:59:48.250289 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.250249 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-69kzr" podStartSLOduration=3.293912122 podStartE2EDuration="4.250232131s" totalImagesPullingTime="956.320009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:48.249954493 +0000 UTC m=+260.267202011" watchObservedRunningTime="2026-06-14 14:59:48.250232131 +0000 UTC m=+260.267479652" Jun 14 14:59:48.289041 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:48.288994 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f7wd4" podStartSLOduration=2.722446872 podStartE2EDuration="4.288978225s" totalImagesPullingTime="1.468888381s" totalInitContainerRuntime="97.642972ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:48.28829291 +0000 UTC m=+260.305540448" watchObservedRunningTime="2026-06-14 14:59:48.288978225 +0000 UTC m=+260.306225759" Jun 14 14:59:49.306084 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.306032 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58b6656496-4hqxq"] Jun 14 14:59:49.308709 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.308687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.311242 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.311213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 14:59:49.312510 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.312361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8rd48\"" Jun 14 14:59:49.312510 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.312373 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 14:59:49.312510 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.312468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 14:59:49.312734 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.312512 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5r5be6ko5rgka\"" Jun 14 14:59:49.312734 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.312514 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 14:59:49.314514 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-client-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.314622 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqpk\" (UniqueName: \"kubernetes.io/projected/1134bcb3-955a-43c6-8ebd-29568d9744e2-kube-api-access-vdqpk\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.314887 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.314985 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-metrics-server-audit-profiles\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.314985 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-tls\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.314985 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.314973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1134bcb3-955a-43c6-8ebd-29568d9744e2-audit-log\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.315231 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.315209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-client-certs\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.318698 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.318652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58b6656496-4hqxq"] Jun 14 14:59:49.416571 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.416537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-client-certs\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.416571 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.416576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-client-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.416830 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.416604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqpk\" (UniqueName: \"kubernetes.io/projected/1134bcb3-955a-43c6-8ebd-29568d9744e2-kube-api-access-vdqpk\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.416830 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.416648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.416830 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.416685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-metrics-server-audit-profiles\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.417194 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.417058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-tls\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.417194 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.417095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1134bcb3-955a-43c6-8ebd-29568d9744e2-audit-log\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.417705 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.417664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1134bcb3-955a-43c6-8ebd-29568d9744e2-audit-log\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.418014 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.417992 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.418227 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.418203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1134bcb3-955a-43c6-8ebd-29568d9744e2-metrics-server-audit-profiles\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.419632 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.419613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-client-certs\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.419979 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.419958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-client-ca-bundle\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.420046 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.419958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1134bcb3-955a-43c6-8ebd-29568d9744e2-secret-metrics-server-tls\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.424544 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.424522 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqpk\" (UniqueName: \"kubernetes.io/projected/1134bcb3-955a-43c6-8ebd-29568d9744e2-kube-api-access-vdqpk\") pod \"metrics-server-58b6656496-4hqxq\" (UID: \"1134bcb3-955a-43c6-8ebd-29568d9744e2\") " pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.619450 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.619361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 14:59:49.750705 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.750675 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 14:59:49.754065 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.754044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.764563 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.764426 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 14:59:49.773458 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.773430 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58b6656496-4hqxq"] Jun 14 14:59:49.776303 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:49.776260 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1134bcb3_955a_43c6_8ebd_29568d9744e2.slice/crio-19762b26b656e0143d5cd13215cb40ff637a806cf1b26db01a5e0c144f51326a WatchSource:0}: Error finding container 19762b26b656e0143d5cd13215cb40ff637a806cf1b26db01a5e0c144f51326a: Status 404 returned error can't find the container with id 19762b26b656e0143d5cd13215cb40ff637a806cf1b26db01a5e0c144f51326a Jun 14 14:59:49.821014 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.820983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821114 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821178 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821282 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821353 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwx7\" (UniqueName: \"kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821353 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.821353 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.821351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922114 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922274 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922274 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922274 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922274 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwx7\" (UniqueName: \"kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922550 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.922550 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.922323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.923288 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.923202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.923364 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.923309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.923364 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.923334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.923364 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.923311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.924890 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.924870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.925230 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.925211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:49.934209 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:49.934186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwx7\" (UniqueName: \"kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7\") pod \"console-58d674f658-szd9q\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:50.077377 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.077339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d674f658-szd9q" Jun 14 14:59:50.231610 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.231586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 14:59:50.233788 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:50.233736 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf120e4_468e_4053_bd02_294c44702a9c.slice/crio-60fa893a80fedeb62b70b490ec92a3af77e66a3f9745b1d61cc27cde90eb665d WatchSource:0}: Error finding container 60fa893a80fedeb62b70b490ec92a3af77e66a3f9745b1d61cc27cde90eb665d: Status 404 returned error can't find the container with id 60fa893a80fedeb62b70b490ec92a3af77e66a3f9745b1d61cc27cde90eb665d Jun 14 14:59:50.244946 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.244924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" event={"ID":"1134bcb3-955a-43c6-8ebd-29568d9744e2","Type":"ContainerStarted","Data":"19762b26b656e0143d5cd13215cb40ff637a806cf1b26db01a5e0c144f51326a"} Jun 14 14:59:50.247705 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.247682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e"} Jun 14 14:59:50.247825 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.247745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152"} Jun 14 14:59:50.247825 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.247799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa"} Jun 14 14:59:50.247825 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.247824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389"} Jun 14 14:59:50.247979 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.247851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b"} Jun 14 14:59:50.248753 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:50.248733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d674f658-szd9q" event={"ID":"dcf120e4-468e-4053-bd02-294c44702a9c","Type":"ContainerStarted","Data":"60fa893a80fedeb62b70b490ec92a3af77e66a3f9745b1d61cc27cde90eb665d"} Jun 14 14:59:51.003651 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.003603 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:51.004130 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.003669 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:51.073543 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.073499 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:59:51.077606 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.077584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.080231 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 14:59:51.080342 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080205 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 14:59:51.080342 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080320 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 14:59:51.080459 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080339 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 14:59:51.080459 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080446 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 14:59:51.080563 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.080458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 14:59:51.081173 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 14:59:51.081173 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 14:59:51.081455 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-79s9gcfnt34vv\"" Jun 14 14:59:51.081564 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081544 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 14:59:51.081716 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 14:59:51.081925 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 14:59:51.082012 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 14:59:51.082012 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081988 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mcj2b\"" Jun 14 14:59:51.082125 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.081989 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 14:59:51.084011 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.083984 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 14:59:51.091590 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.091570 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:59:51.134686 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134686 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxcw\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.134934 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.134936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135234 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.135506 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.135347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.235989 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.235957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.235989 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.235994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxcw\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236192 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236531 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236941 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236941 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236941 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236941 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.236941 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.237178 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.236997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.237178 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.237058 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.237609 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.237297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.237897 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.237871 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.239014 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.238687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.240336 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.240035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.240582 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.240558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.240661 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.240644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.240975 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.240951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.241036 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.240993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.241784 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.241463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.242037 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.242010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.242533 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.242494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.242725 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.242685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.242820 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.242791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.243181 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.243163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.243697 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.243672 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.244659 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.244637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxcw\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw\") pod \"prometheus-k8s-0\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.255565 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.255488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d674f658-szd9q" event={"ID":"dcf120e4-468e-4053-bd02-294c44702a9c","Type":"ContainerStarted","Data":"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611"} Jun 14 14:59:51.274888 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.274847 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58d674f658-szd9q" podStartSLOduration=2.274832745 podStartE2EDuration="2.274832745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:51.273387339 +0000 UTC m=+263.290634860" watchObservedRunningTime="2026-06-14 14:59:51.274832745 +0000 UTC m=+263.292080263" Jun 14 14:59:51.389262 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.389232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 14:59:51.531057 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:51.530928 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 14:59:51.533659 ip-10-0-139-109 kubenswrapper[2577]: W0614 14:59:51.533628 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ac0a6f_fb88_434f_99c2_6a39715828be.slice/crio-baa57d312694fae572141aa73f0e9f27855eb884443cd4e93eae51d0b257a331 WatchSource:0}: Error finding container baa57d312694fae572141aa73f0e9f27855eb884443cd4e93eae51d0b257a331: Status 404 returned error can't find the container with id baa57d312694fae572141aa73f0e9f27855eb884443cd4e93eae51d0b257a331 Jun 14 14:59:52.260774 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.260732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" event={"ID":"1134bcb3-955a-43c6-8ebd-29568d9744e2","Type":"ContainerStarted","Data":"e1485342476ecc171f0ebf049c10b849425228dc5145ee47d54b8eb73ba98766"} Jun 14 14:59:52.262207 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.262182 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="8f1acaa3ef1e3b42d302a03a7a48c4610a8a085883e667ebf7d29b051f908ec2" exitCode=0 Jun 14 14:59:52.262328 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.262278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"8f1acaa3ef1e3b42d302a03a7a48c4610a8a085883e667ebf7d29b051f908ec2"} Jun 14 14:59:52.262389 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.262349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"baa57d312694fae572141aa73f0e9f27855eb884443cd4e93eae51d0b257a331"} Jun 14 14:59:52.265788 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.265745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerStarted","Data":"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03"} Jun 14 14:59:52.277536 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.277496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" podStartSLOduration=1.808609412 podStartE2EDuration="3.277482872s" totalImagesPullingTime="1.46887346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:52.276162323 +0000 UTC m=+264.293409844" watchObservedRunningTime="2026-06-14 14:59:52.277482872 +0000 UTC m=+264.294730391" Jun 14 14:59:52.302712 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:52.302649 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.467469987 podStartE2EDuration="7.302635745s" totalImagesPullingTime="3.817433891s" totalInitContainerRuntime="17.731867ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:52.301131528 +0000 UTC m=+264.318379045" watchObservedRunningTime="2026-06-14 14:59:52.302635745 +0000 UTC m=+264.319883263" Jun 14 14:59:53.117000 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:53.116951 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:59:53.117167 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:53.117013 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:59:53.341991 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:53.341953 2577 patch_prober.go:28] interesting pod/console-7cb9d48b86-l9jwn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 14 14:59:53.342356 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:53.342012 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7cb9d48b86-l9jwn" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 14 14:59:55.281980 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:55.281952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"1c1027e2240c396091f4a3133675b44c2c5efa9a573c32601ec6592af3f0fd36"} Jun 14 14:59:56.290162 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:56.290129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"568a7ed17c5a899ad4d0056cc446235a530ac0d41936373e39bee22839e30547"} Jun 14 14:59:56.500784 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:56.500737 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 14:59:57.298363 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:57.298326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"bba17c224ef5cb1ed3c9ff6801f92ca11ce1f08de2a945a3b98edc00d740d1a1"} Jun 14 14:59:57.298745 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:57.298401 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"3af96df10902ad7504055c6e036a047b87d76804e9029d121047c26647ac0323"} Jun 14 14:59:57.298745 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:57.298443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"496e55989da45c2b48d6a77ef71775e7792f8a07d6a1cf5e0772d5ab1eecc08f"} Jun 14 14:59:57.298745 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:57.298479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerStarted","Data":"3eb0dc18a6d102a8b299e8d1b2823d4a7e1b99a3d087de3aa06993dc3687a368"} Jun 14 14:59:57.327033 ip-10-0-139-109 kubenswrapper[2577]: I0614 14:59:57.326980 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.803165218 podStartE2EDuration="6.326953256s" totalImagesPullingTime="4.501688355s" totalInitContainerRuntime="22.099683ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:57.325678283 +0000 UTC m=+269.342925816" watchObservedRunningTime="2026-06-14 14:59:57.326953256 +0000 UTC m=+269.344200775" Jun 14 15:00:00.078387 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:00.078345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:00.078793 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:00.078444 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:00.083201 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:00.083175 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:00.315155 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:00.315125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:01.001640 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.001602 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 15:00:01.001838 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.001655 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:00:01.001838 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.001696 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 15:00:01.002252 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.002229 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b2abbff381213319349634fc05f4b740f4101e9c70147e59764731877b7aac8a"} pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" containerMessage="Container registry failed liveness probe, will be restarted" Jun 14 15:00:01.005910 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.005884 2577 patch_prober.go:28] interesting pod/image-registry-7645cd7dfb-f2hj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 15:00:01.006011 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.005931 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:00:01.390067 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:01.389987 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:00:07.886164 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:07.885595 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 15:00:09.620092 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:09.620054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 15:00:09.620481 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:09.620147 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 15:00:09.884209 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:00:09.884107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s5vxz" podUID="3235f6e0-17e1-4ecc-93f0-31c4643c9d94" Jun 14 15:00:10.353707 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:10.353675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:11.005955 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:11.005925 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 15:00:13.850857 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:13.850823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:13.853177 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:13.853159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3235f6e0-17e1-4ecc-93f0-31c4643c9d94-metrics-tls\") pod \"dns-default-s5vxz\" (UID: \"3235f6e0-17e1-4ecc-93f0-31c4643c9d94\") " pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:13.956895 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:13.956863 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 15:00:13.964773 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:13.964734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:14.090915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:14.090886 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5vxz"] Jun 14 15:00:14.094195 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:00:14.094167 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3235f6e0_17e1_4ecc_93f0_31c4643c9d94.slice/crio-f590ac911c3de2886073750490e3bec95fc73e1f1a9126adcb95b381fbc947ae WatchSource:0}: Error finding container f590ac911c3de2886073750490e3bec95fc73e1f1a9126adcb95b381fbc947ae: Status 404 returned error can't find the container with id f590ac911c3de2886073750490e3bec95fc73e1f1a9126adcb95b381fbc947ae Jun 14 15:00:14.371346 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:14.371266 2577 generic.go:356] "Generic (PLEG): container finished" podID="31733dd6-33fb-44bd-8662-3359ce9e7414" containerID="6fe6995da4a70ebef7e960278b43c5cdd7814455f1dec91871032158083f0831" exitCode=0 Jun 14 15:00:14.371488 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:14.371339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" event={"ID":"31733dd6-33fb-44bd-8662-3359ce9e7414","Type":"ContainerDied","Data":"6fe6995da4a70ebef7e960278b43c5cdd7814455f1dec91871032158083f0831"} Jun 14 15:00:14.371642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:14.371624 2577 scope.go:117] "RemoveContainer" containerID="6fe6995da4a70ebef7e960278b43c5cdd7814455f1dec91871032158083f0831" Jun 14 15:00:14.372511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:14.372492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5vxz" event={"ID":"3235f6e0-17e1-4ecc-93f0-31c4643c9d94","Type":"ContainerStarted","Data":"f590ac911c3de2886073750490e3bec95fc73e1f1a9126adcb95b381fbc947ae"} Jun 14 15:00:15.379318 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:15.379275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-k8pbq" event={"ID":"31733dd6-33fb-44bd-8662-3359ce9e7414","Type":"ContainerStarted","Data":"1bda5ff8225e4bd4a4a5a4c6de393296228caf93aa646b479f15f8d080f6dd1e"} Jun 14 15:00:16.385572 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:16.385535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5vxz" event={"ID":"3235f6e0-17e1-4ecc-93f0-31c4643c9d94","Type":"ContainerStarted","Data":"062c7f85f48817d4c130fec44951115c7a7cf8a923b8980ca44e917d8261e6ef"} Jun 14 15:00:16.386008 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:16.385586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5vxz" event={"ID":"3235f6e0-17e1-4ecc-93f0-31c4643c9d94","Type":"ContainerStarted","Data":"34ace6ba88a3285b7d991ddabc063e8455e41bcb4245013d65343f209d479b4f"} Jun 14 15:00:16.386008 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:16.385672 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:16.404347 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:16.404297 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s5vxz" podStartSLOduration=251.850575722 podStartE2EDuration="4m13.404279994s" totalImagesPullingTime="1.553704272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:00:16.402152954 +0000 UTC m=+288.419400484" watchObservedRunningTime="2026-06-14 15:00:16.404279994 +0000 UTC m=+288.421527556" Jun 14 15:00:21.524089 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.524049 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cb9d48b86-l9jwn" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" containerID="cri-o://f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e" gracePeriod=15 Jun 14 15:00:21.782386 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.782334 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 15:00:21.934236 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934203 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934409 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934409 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934297 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934409 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934371 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xtx7\" (UniqueName: \"kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934409 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934399 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934568 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934432 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934568 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934477 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert\") pod \"da938d1c-006f-4149-885c-0a653f5a3911\" (UID: \"da938d1c-006f-4149-885c-0a653f5a3911\") " Jun 14 15:00:21.934864 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934830 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca" (OuterVolumeSpecName: "service-ca") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:21.935093 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934834 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config" (OuterVolumeSpecName: "console-config") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:21.935093 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.934879 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:21.935093 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.935081 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:21.936607 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.936577 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:21.936834 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.936814 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:21.936910 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:21.936839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7" (OuterVolumeSpecName: "kube-api-access-5xtx7") pod "da938d1c-006f-4149-885c-0a653f5a3911" (UID: "da938d1c-006f-4149-885c-0a653f5a3911"). InnerVolumeSpecName "kube-api-access-5xtx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035613 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xtx7\" (UniqueName: \"kubernetes.io/projected/da938d1c-006f-4149-885c-0a653f5a3911-kube-api-access-5xtx7\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035642 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-console-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035651 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035660 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-oauth-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035669 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-oauth-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035679 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da938d1c-006f-4149-885c-0a653f5a3911-console-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.035696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.035687 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da938d1c-006f-4149-885c-0a653f5a3911-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:22.413190 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.413161 2577 generic.go:356] "Generic (PLEG): container finished" podID="da938d1c-006f-4149-885c-0a653f5a3911" containerID="f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e" exitCode=0 Jun 14 15:00:22.413336 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.413200 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb9d48b86-l9jwn" Jun 14 15:00:22.413336 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.413253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb9d48b86-l9jwn" event={"ID":"da938d1c-006f-4149-885c-0a653f5a3911","Type":"ContainerDied","Data":"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e"} Jun 14 15:00:22.413336 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.413297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb9d48b86-l9jwn" event={"ID":"da938d1c-006f-4149-885c-0a653f5a3911","Type":"ContainerDied","Data":"10ae95167c76076c15e2faad517c3ead7e4811f1456c3b580e5fed4d537fce0c"} Jun 14 15:00:22.413336 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.413316 2577 scope.go:117] "RemoveContainer" containerID="f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e" Jun 14 15:00:22.421415 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.421400 2577 scope.go:117] "RemoveContainer" containerID="f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e" Jun 14 15:00:22.421673 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:00:22.421652 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e\": container with ID starting with f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e not found: ID does not exist" containerID="f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e" Jun 14 15:00:22.421725 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.421681 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e"} err="failed to get container status \"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e\": rpc error: code = NotFound desc = could not find container \"f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e\": container with ID starting with f05243cfd9bd23f806c507c0cbc996530b9aa91ce990ee33312c910eb2727a1e not found: ID does not exist" Jun 14 15:00:22.429461 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.429442 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 15:00:22.435427 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:22.435408 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb9d48b86-l9jwn"] Jun 14 15:00:23.418624 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:23.418537 2577 generic.go:356] "Generic (PLEG): container finished" podID="501e576f-0e7b-4f44-bf07-548b6f693b63" containerID="6816e405e5cc076625fd2b84db5089a4e908127fbcc9e6a30f77211ac6b05884" exitCode=0 Jun 14 15:00:23.419101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:23.418613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" event={"ID":"501e576f-0e7b-4f44-bf07-548b6f693b63","Type":"ContainerDied","Data":"6816e405e5cc076625fd2b84db5089a4e908127fbcc9e6a30f77211ac6b05884"} Jun 14 15:00:23.419101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:23.419031 2577 scope.go:117] "RemoveContainer" containerID="6816e405e5cc076625fd2b84db5089a4e908127fbcc9e6a30f77211ac6b05884" Jun 14 15:00:24.394129 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:24.394099 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da938d1c-006f-4149-885c-0a653f5a3911" path="/var/lib/kubelet/pods/da938d1c-006f-4149-885c-0a653f5a3911/volumes" Jun 14 15:00:24.425736 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:24.425697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gkrrb" event={"ID":"501e576f-0e7b-4f44-bf07-548b6f693b63","Type":"ContainerStarted","Data":"7d8e40f9ee06d4af22fe619dc6befaf61885994a4377e23f90d7a4ddceeacfae"} Jun 14 15:00:26.021193 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.021155 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" podUID="591befad-2872-424b-aeb4-f69b25a10948" containerName="registry" containerID="cri-o://b2abbff381213319349634fc05f4b740f4101e9c70147e59764731877b7aac8a" gracePeriod=30 Jun 14 15:00:26.395611 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.395541 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5vxz" Jun 14 15:00:26.436725 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.436692 2577 generic.go:356] "Generic (PLEG): container finished" podID="591befad-2872-424b-aeb4-f69b25a10948" containerID="b2abbff381213319349634fc05f4b740f4101e9c70147e59764731877b7aac8a" exitCode=0 Jun 14 15:00:26.436926 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.436785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" event={"ID":"591befad-2872-424b-aeb4-f69b25a10948","Type":"ContainerDied","Data":"b2abbff381213319349634fc05f4b740f4101e9c70147e59764731877b7aac8a"} Jun 14 15:00:26.437004 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.436936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 15:00:26.437004 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:26.436968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" event={"ID":"591befad-2872-424b-aeb4-f69b25a10948","Type":"ContainerStarted","Data":"31e185eb4c33e9881a613af2e3308cabb49a2c4a68730536ae4521eccde3e5d8"} Jun 14 15:00:28.338067 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.338041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:00:28.338658 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.338635 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:00:28.341219 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.341200 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 15:00:28.445255 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.445107 2577 generic.go:356] "Generic (PLEG): container finished" podID="6c3dce43-c768-4895-b6d4-1a329369ee38" containerID="70217ac2d628987c29a8455e2c76523432cfe738ef5fd5dfab441259c89016fe" exitCode=0 Jun 14 15:00:28.445255 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.445181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" event={"ID":"6c3dce43-c768-4895-b6d4-1a329369ee38","Type":"ContainerDied","Data":"70217ac2d628987c29a8455e2c76523432cfe738ef5fd5dfab441259c89016fe"} Jun 14 15:00:28.449940 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:28.445534 2577 scope.go:117] "RemoveContainer" containerID="70217ac2d628987c29a8455e2c76523432cfe738ef5fd5dfab441259c89016fe" Jun 14 15:00:29.106097 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.106068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7645cd7dfb-f2hj6_591befad-2872-424b-aeb4-f69b25a10948/registry/0.log" Jun 14 15:00:29.112115 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.112092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7645cd7dfb-f2hj6_591befad-2872-424b-aeb4-f69b25a10948/registry/1.log" Jun 14 15:00:29.124029 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.124007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqkws_317cfac5-b421-41f2-bfa1-f4b165180a51/node-ca/0.log" Jun 14 15:00:29.452311 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.452221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-p2b9z" event={"ID":"6c3dce43-c768-4895-b6d4-1a329369ee38","Type":"ContainerStarted","Data":"7c23135b3e55ecdb99aa0a594d6a777babd3be063745f8b0271a67048f9b4b5f"} Jun 14 15:00:29.625914 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.625884 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 15:00:29.630101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:29.630083 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58b6656496-4hqxq" Jun 14 15:00:32.909685 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:32.909628 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58d674f658-szd9q" podUID="dcf120e4-468e-4053-bd02-294c44702a9c" containerName="console" containerID="cri-o://93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611" gracePeriod=15 Jun 14 15:00:33.149695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.149671 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:33.233433 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233403 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233433 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233438 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233678 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233459 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233678 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233483 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233678 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233502 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233862 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233775 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwx7\" (UniqueName: \"kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.233862 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233847 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:33.233961 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233859 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config\") pod \"dcf120e4-468e-4053-bd02-294c44702a9c\" (UID: \"dcf120e4-468e-4053-bd02-294c44702a9c\") " Jun 14 15:00:33.234010 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233953 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config" (OuterVolumeSpecName: "console-config") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:33.234010 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.233962 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca" (OuterVolumeSpecName: "service-ca") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:33.234104 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.234016 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:33.234169 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.234154 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-oauth-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.234209 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.234172 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-service-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.234209 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.234181 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-console-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.234209 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.234188 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcf120e4-468e-4053-bd02-294c44702a9c-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.235704 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.235682 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7" (OuterVolumeSpecName: "kube-api-access-ppwx7") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "kube-api-access-ppwx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:33.236129 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.236108 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:33.236201 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.236125 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dcf120e4-468e-4053-bd02-294c44702a9c" (UID: "dcf120e4-468e-4053-bd02-294c44702a9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:33.334800 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.334752 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-oauth-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.334800 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.334795 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf120e4-468e-4053-bd02-294c44702a9c-console-serving-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.334800 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.334807 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwx7\" (UniqueName: \"kubernetes.io/projected/dcf120e4-468e-4053-bd02-294c44702a9c-kube-api-access-ppwx7\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:00:33.469128 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.469095 2577 generic.go:356] "Generic (PLEG): container finished" podID="dcf120e4-468e-4053-bd02-294c44702a9c" containerID="93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611" exitCode=0 Jun 14 15:00:33.469290 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.469139 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d674f658-szd9q" Jun 14 15:00:33.469290 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.469145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d674f658-szd9q" event={"ID":"dcf120e4-468e-4053-bd02-294c44702a9c","Type":"ContainerDied","Data":"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611"} Jun 14 15:00:33.469290 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.469182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d674f658-szd9q" event={"ID":"dcf120e4-468e-4053-bd02-294c44702a9c","Type":"ContainerDied","Data":"60fa893a80fedeb62b70b490ec92a3af77e66a3f9745b1d61cc27cde90eb665d"} Jun 14 15:00:33.469290 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.469200 2577 scope.go:117] "RemoveContainer" containerID="93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611" Jun 14 15:00:33.478154 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.478137 2577 scope.go:117] "RemoveContainer" containerID="93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611" Jun 14 15:00:33.478394 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:00:33.478378 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611\": container with ID starting with 93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611 not found: ID does not exist" containerID="93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611" Jun 14 15:00:33.478460 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.478401 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611"} err="failed to get container status \"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611\": rpc error: code = NotFound desc = could not find container \"93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611\": container with ID starting with 93507ade5aa5963df1efc09aa51f698ec0ba38d6833d00e03f4f4e2c73438611 not found: ID does not exist" Jun 14 15:00:33.489739 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.489677 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 15:00:33.498208 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:33.498182 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58d674f658-szd9q"] Jun 14 15:00:34.393934 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:34.393905 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf120e4-468e-4053-bd02-294c44702a9c" path="/var/lib/kubelet/pods/dcf120e4-468e-4053-bd02-294c44702a9c/volumes" Jun 14 15:00:47.445217 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:47.445184 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7645cd7dfb-f2hj6" Jun 14 15:00:51.389417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:51.389375 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:00:51.408784 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:51.408743 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:00:51.571657 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:00:51.571630 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:05.210976 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.210941 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211233 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="alertmanager" containerID="cri-o://c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" gracePeriod=120 Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211317 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-metric" containerID="cri-o://ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" gracePeriod=120 Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211351 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-web" containerID="cri-o://5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" gracePeriod=120 Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211401 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy" containerID="cri-o://a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" gracePeriod=120 Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211362 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="config-reloader" containerID="cri-o://a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" gracePeriod=120 Jun 14 15:01:05.211511 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.211492 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="prom-label-proxy" containerID="cri-o://441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" gracePeriod=120 Jun 14 15:01:05.611827 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611726 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" exitCode=0 Jun 14 15:01:05.611827 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611750 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" exitCode=0 Jun 14 15:01:05.611827 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611772 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" exitCode=0 Jun 14 15:01:05.611827 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611779 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" exitCode=0 Jun 14 15:01:05.611827 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03"} Jun 14 15:01:05.612079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152"} Jun 14 15:01:05.612079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389"} Jun 14 15:01:05.612079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:05.611912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b"} Jun 14 15:01:06.464868 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.464845 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:06.620042 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.619948 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" exitCode=0 Jun 14 15:01:06.620042 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.619976 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d538589-51dd-4c79-8d3c-86376a551622" containerID="5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" exitCode=0 Jun 14 15:01:06.620042 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.620028 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:06.620279 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.620039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e"} Jun 14 15:01:06.620279 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.620116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa"} Jun 14 15:01:06.620279 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.620150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d538589-51dd-4c79-8d3c-86376a551622","Type":"ContainerDied","Data":"fba567586598647d240fb2792de84eac746dac548d386e7fec728e9422e54c2a"} Jun 14 15:01:06.620279 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.620186 2577 scope.go:117] "RemoveContainer" containerID="441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" Jun 14 15:01:06.628018 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.628005 2577 scope.go:117] "RemoveContainer" containerID="ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" Jun 14 15:01:06.630052 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630036 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630144 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630091 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630144 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630119 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630262 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630159 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630262 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630200 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dcjv\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630262 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630235 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630407 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630264 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630407 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630292 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630407 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630330 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630407 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630367 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630597 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630410 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630597 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630456 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630597 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630498 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle\") pod \"5d538589-51dd-4c79-8d3c-86376a551622\" (UID: \"5d538589-51dd-4c79-8d3c-86376a551622\") " Jun 14 15:01:06.630739 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630591 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:06.631168 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.630896 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-metrics-client-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.631168 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.631086 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:01:06.631327 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.631273 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:06.633576 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.633538 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.634493 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634445 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.634493 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634452 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv" (OuterVolumeSpecName: "kube-api-access-2dcjv") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "kube-api-access-2dcjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:01:06.634493 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634466 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out" (OuterVolumeSpecName: "config-out") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:01:06.634751 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634726 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.634852 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634834 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:01:06.634938 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634910 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume" (OuterVolumeSpecName: "config-volume") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.635013 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.634986 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.637078 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.637060 2577 scope.go:117] "RemoveContainer" containerID="a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" Jun 14 15:01:06.639252 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.638881 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.646963 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.646934 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config" (OuterVolumeSpecName: "web-config") pod "5d538589-51dd-4c79-8d3c-86376a551622" (UID: "5d538589-51dd-4c79-8d3c-86376a551622"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:06.647699 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.647678 2577 scope.go:117] "RemoveContainer" containerID="5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" Jun 14 15:01:06.654246 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.654222 2577 scope.go:117] "RemoveContainer" containerID="a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" Jun 14 15:01:06.660796 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.660777 2577 scope.go:117] "RemoveContainer" containerID="c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" Jun 14 15:01:06.667712 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.667696 2577 scope.go:117] "RemoveContainer" containerID="44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41" Jun 14 15:01:06.674466 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.674449 2577 scope.go:117] "RemoveContainer" containerID="441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" Jun 14 15:01:06.674711 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.674692 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03\": container with ID starting with 441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03 not found: ID does not exist" containerID="441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" Jun 14 15:01:06.674786 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.674720 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03"} err="failed to get container status \"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03\": rpc error: code = NotFound desc = could not find container \"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03\": container with ID starting with 441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03 not found: ID does not exist" Jun 14 15:01:06.674786 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.674740 2577 scope.go:117] "RemoveContainer" containerID="ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" Jun 14 15:01:06.674987 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.674971 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e\": container with ID starting with ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e not found: ID does not exist" containerID="ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" Jun 14 15:01:06.675026 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.674991 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e"} err="failed to get container status \"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e\": rpc error: code = NotFound desc = could not find container \"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e\": container with ID starting with ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e not found: ID does not exist" Jun 14 15:01:06.675026 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675005 2577 scope.go:117] "RemoveContainer" containerID="a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" Jun 14 15:01:06.675239 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.675225 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152\": container with ID starting with a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152 not found: ID does not exist" containerID="a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" Jun 14 15:01:06.675291 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675241 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152"} err="failed to get container status \"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152\": rpc error: code = NotFound desc = could not find container \"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152\": container with ID starting with a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152 not found: ID does not exist" Jun 14 15:01:06.675291 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675252 2577 scope.go:117] "RemoveContainer" containerID="5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" Jun 14 15:01:06.675408 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.675392 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa\": container with ID starting with 5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa not found: ID does not exist" containerID="5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" Jun 14 15:01:06.675471 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675409 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa"} err="failed to get container status \"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa\": rpc error: code = NotFound desc = could not find container \"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa\": container with ID starting with 5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa not found: ID does not exist" Jun 14 15:01:06.675471 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675419 2577 scope.go:117] "RemoveContainer" containerID="a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" Jun 14 15:01:06.675624 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.675608 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389\": container with ID starting with a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389 not found: ID does not exist" containerID="a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" Jun 14 15:01:06.675663 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675632 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389"} err="failed to get container status \"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389\": rpc error: code = NotFound desc = could not find container \"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389\": container with ID starting with a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389 not found: ID does not exist" Jun 14 15:01:06.675663 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675647 2577 scope.go:117] "RemoveContainer" containerID="c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" Jun 14 15:01:06.675935 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.675918 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b\": container with ID starting with c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b not found: ID does not exist" containerID="c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" Jun 14 15:01:06.675979 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675940 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b"} err="failed to get container status \"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b\": rpc error: code = NotFound desc = could not find container \"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b\": container with ID starting with c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b not found: ID does not exist" Jun 14 15:01:06.675979 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.675959 2577 scope.go:117] "RemoveContainer" containerID="44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41" Jun 14 15:01:06.676195 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:01:06.676179 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41\": container with ID starting with 44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41 not found: ID does not exist" containerID="44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41" Jun 14 15:01:06.676234 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676200 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41"} err="failed to get container status \"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41\": rpc error: code = NotFound desc = could not find container \"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41\": container with ID starting with 44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41 not found: ID does not exist" Jun 14 15:01:06.676234 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676214 2577 scope.go:117] "RemoveContainer" containerID="441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03" Jun 14 15:01:06.676406 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676391 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03"} err="failed to get container status \"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03\": rpc error: code = NotFound desc = could not find container \"441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03\": container with ID starting with 441b795f558da78ce3c1a1742bb2c65661c056561f4a9dfcf0833f54ce400c03 not found: ID does not exist" Jun 14 15:01:06.676447 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676406 2577 scope.go:117] "RemoveContainer" containerID="ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e" Jun 14 15:01:06.676638 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676620 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e"} err="failed to get container status \"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e\": rpc error: code = NotFound desc = could not find container \"ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e\": container with ID starting with ebd8537c18faf1e0844403a2e16860252eaed38a3c4cf130efb38c817ecc5d3e not found: ID does not exist" Jun 14 15:01:06.676694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676637 2577 scope.go:117] "RemoveContainer" containerID="a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152" Jun 14 15:01:06.676833 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676818 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152"} err="failed to get container status \"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152\": rpc error: code = NotFound desc = could not find container \"a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152\": container with ID starting with a9b0deb8c1e61877e82001af85d67eec28356bd4be1d30946038ac13fa211152 not found: ID does not exist" Jun 14 15:01:06.676885 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.676833 2577 scope.go:117] "RemoveContainer" containerID="5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa" Jun 14 15:01:06.677022 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677006 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa"} err="failed to get container status \"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa\": rpc error: code = NotFound desc = could not find container \"5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa\": container with ID starting with 5c678e7f520e482f9b558c31425edda872945afde6188f000e8de848277ad4fa not found: ID does not exist" Jun 14 15:01:06.677069 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677023 2577 scope.go:117] "RemoveContainer" containerID="a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389" Jun 14 15:01:06.677247 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677228 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389"} err="failed to get container status \"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389\": rpc error: code = NotFound desc = could not find container \"a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389\": container with ID starting with a74725fc64c435c96db30ee5a4a6ef0335051c49b9250c209a55f95161da6389 not found: ID does not exist" Jun 14 15:01:06.677322 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677250 2577 scope.go:117] "RemoveContainer" containerID="c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b" Jun 14 15:01:06.677478 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677463 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b"} err="failed to get container status \"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b\": rpc error: code = NotFound desc = could not find container \"c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b\": container with ID starting with c938c31075256bea0c5e194da3a2199138bdf80091804ccef3be429e10fe486b not found: ID does not exist" Jun 14 15:01:06.677535 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677477 2577 scope.go:117] "RemoveContainer" containerID="44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41" Jun 14 15:01:06.677663 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.677645 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41"} err="failed to get container status \"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41\": rpc error: code = NotFound desc = could not find container \"44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41\": container with ID starting with 44b1866081fa269c1290b97d64a23523fb7ac8b9bd1311f2e1c071ef39a66e41 not found: ID does not exist" Jun 14 15:01:06.732054 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732022 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732054 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732048 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-web-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732054 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732059 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-cluster-tls-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732068 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dcjv\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-kube-api-access-2dcjv\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732077 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732085 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-main-db\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732094 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-main-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732104 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-config-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732112 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d538589-51dd-4c79-8d3c-86376a551622-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732120 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d538589-51dd-4c79-8d3c-86376a551622-tls-assets\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732129 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d538589-51dd-4c79-8d3c-86376a551622-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.732268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.732137 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d538589-51dd-4c79-8d3c-86376a551622-config-out\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:06.945517 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.945482 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:06.952400 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:06.952374 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:08.393368 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:08.393322 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d538589-51dd-4c79-8d3c-86376a551622" path="/var/lib/kubelet/pods/5d538589-51dd-4c79-8d3c-86376a551622/volumes" Jun 14 15:01:09.469675 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.469641 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:09.470075 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.469975 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="prometheus" containerID="cri-o://1c1027e2240c396091f4a3133675b44c2c5efa9a573c32601ec6592af3f0fd36" gracePeriod=600 Jun 14 15:01:09.470075 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.470003 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy" containerID="cri-o://3af96df10902ad7504055c6e036a047b87d76804e9029d121047c26647ac0323" gracePeriod=600 Jun 14 15:01:09.470075 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.470038 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="config-reloader" containerID="cri-o://568a7ed17c5a899ad4d0056cc446235a530ac0d41936373e39bee22839e30547" gracePeriod=600 Jun 14 15:01:09.470277 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.470030 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bba17c224ef5cb1ed3c9ff6801f92ca11ce1f08de2a945a3b98edc00d740d1a1" gracePeriod=600 Jun 14 15:01:09.470277 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.470017 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="thanos-sidecar" containerID="cri-o://3eb0dc18a6d102a8b299e8d1b2823d4a7e1b99a3d087de3aa06993dc3687a368" gracePeriod=600 Jun 14 15:01:09.470277 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.470050 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-web" containerID="cri-o://496e55989da45c2b48d6a77ef71775e7792f8a07d6a1cf5e0772d5ab1eecc08f" gracePeriod=600 Jun 14 15:01:09.636417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636385 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="bba17c224ef5cb1ed3c9ff6801f92ca11ce1f08de2a945a3b98edc00d740d1a1" exitCode=0 Jun 14 15:01:09.636417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636413 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="3af96df10902ad7504055c6e036a047b87d76804e9029d121047c26647ac0323" exitCode=0 Jun 14 15:01:09.636417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636420 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="496e55989da45c2b48d6a77ef71775e7792f8a07d6a1cf5e0772d5ab1eecc08f" exitCode=0 Jun 14 15:01:09.636417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636426 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="3eb0dc18a6d102a8b299e8d1b2823d4a7e1b99a3d087de3aa06993dc3687a368" exitCode=0 Jun 14 15:01:09.636417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636431 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="568a7ed17c5a899ad4d0056cc446235a530ac0d41936373e39bee22839e30547" exitCode=0 Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636438 2577 generic.go:356] "Generic (PLEG): container finished" podID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerID="1c1027e2240c396091f4a3133675b44c2c5efa9a573c32601ec6592af3f0fd36" exitCode=0 Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"bba17c224ef5cb1ed3c9ff6801f92ca11ce1f08de2a945a3b98edc00d740d1a1"} Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"3af96df10902ad7504055c6e036a047b87d76804e9029d121047c26647ac0323"} Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"496e55989da45c2b48d6a77ef71775e7792f8a07d6a1cf5e0772d5ab1eecc08f"} Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"3eb0dc18a6d102a8b299e8d1b2823d4a7e1b99a3d087de3aa06993dc3687a368"} Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"568a7ed17c5a899ad4d0056cc446235a530ac0d41936373e39bee22839e30547"} Jun 14 15:01:09.636695 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.636631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"1c1027e2240c396091f4a3133675b44c2c5efa9a573c32601ec6592af3f0fd36"} Jun 14 15:01:09.720415 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.720348 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:09.758448 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758411 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758636 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758530 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758636 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758552 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758636 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758576 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758636 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758620 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758648 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758671 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758721 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758743 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758808 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758837 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758867 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxxcw\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.758900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758898 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758925 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758953 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.758991 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759002 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759063 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759102 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.759364 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759165 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.759703 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759415 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.759703 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759436 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.759703 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.759470 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.760488 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.760229 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.761383 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.761127 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.762069 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.762034 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.762178 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.762156 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.762252 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.762227 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.763146 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.762937 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:01:09.763441 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763361 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:01:09.763441 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763400 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.763781 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763440 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:09.764012 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763836 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw" (OuterVolumeSpecName: "kube-api-access-lxxcw") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "kube-api-access-lxxcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:01:09.764012 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763928 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.764012 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.763968 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config" (OuterVolumeSpecName: "config") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.764513 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.764489 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.765422 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.765397 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out" (OuterVolumeSpecName: "config-out") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:01:09.765525 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.765457 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.776550 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.776529 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config" (OuterVolumeSpecName: "web-config") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.860084 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860047 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy\") pod \"68ac0a6f-fb88-434f-99c2-6a39715828be\" (UID: \"68ac0a6f-fb88-434f-99c2-6a39715828be\") " Jun 14 15:01:09.860295 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860279 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860300 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-config-out\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860316 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxxcw\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-kube-api-access-lxxcw\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860330 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860346 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860360 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-metrics-client-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860376 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860389 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-web-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860402 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860416 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-grpc-tls\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860429 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860442 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ac0a6f-fb88-434f-99c2-6a39715828be-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860457 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860471 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68ac0a6f-fb88-434f-99c2-6a39715828be-tls-assets\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860483 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-config\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860495 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68ac0a6f-fb88-434f-99c2-6a39715828be-prometheus-k8s-db\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.860601 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.860508 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-metrics-client-certs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:09.861974 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.861952 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68ac0a6f-fb88-434f-99c2-6a39715828be" (UID: "68ac0a6f-fb88-434f-99c2-6a39715828be"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:09.961559 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:09.961514 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68ac0a6f-fb88-434f-99c2-6a39715828be-secret-kube-rbac-proxy\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:01:10.643002 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.642970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68ac0a6f-fb88-434f-99c2-6a39715828be","Type":"ContainerDied","Data":"baa57d312694fae572141aa73f0e9f27855eb884443cd4e93eae51d0b257a331"} Jun 14 15:01:10.643435 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.643043 2577 scope.go:117] "RemoveContainer" containerID="bba17c224ef5cb1ed3c9ff6801f92ca11ce1f08de2a945a3b98edc00d740d1a1" Jun 14 15:01:10.643435 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.643042 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.650686 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.650668 2577 scope.go:117] "RemoveContainer" containerID="3af96df10902ad7504055c6e036a047b87d76804e9029d121047c26647ac0323" Jun 14 15:01:10.657969 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.657953 2577 scope.go:117] "RemoveContainer" containerID="496e55989da45c2b48d6a77ef71775e7792f8a07d6a1cf5e0772d5ab1eecc08f" Jun 14 15:01:10.664828 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.664806 2577 scope.go:117] "RemoveContainer" containerID="3eb0dc18a6d102a8b299e8d1b2823d4a7e1b99a3d087de3aa06993dc3687a368" Jun 14 15:01:10.666951 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.666925 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:10.671949 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.671924 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:10.673496 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.673474 2577 scope.go:117] "RemoveContainer" containerID="568a7ed17c5a899ad4d0056cc446235a530ac0d41936373e39bee22839e30547" Jun 14 15:01:10.680591 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.680574 2577 scope.go:117] "RemoveContainer" containerID="1c1027e2240c396091f4a3133675b44c2c5efa9a573c32601ec6592af3f0fd36" Jun 14 15:01:10.690298 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.690279 2577 scope.go:117] "RemoveContainer" containerID="8f1acaa3ef1e3b42d302a03a7a48c4610a8a085883e667ebf7d29b051f908ec2" Jun 14 15:01:10.696154 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696132 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:10.696414 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696400 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="init-config-reloader" Jun 14 15:01:10.696414 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696414 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="init-config-reloader" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696423 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696429 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696440 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696445 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696452 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf120e4-468e-4053-bd02-294c44702a9c" containerName="console" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696457 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf120e4-468e-4053-bd02-294c44702a9c" containerName="console" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="prometheus" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696468 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="prometheus" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696477 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696482 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696489 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="config-reloader" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696494 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="config-reloader" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696499 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.696499 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696504 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696510 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-thanos" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696515 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-thanos" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696525 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="init-config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696530 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="init-config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696538 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696543 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696549 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="thanos-sidecar" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696553 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="thanos-sidecar" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696559 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-metric" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696564 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-metric" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696569 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="prom-label-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696574 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="prom-label-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696580 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="alertmanager" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696584 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="alertmanager" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696589 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696594 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696635 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="prometheus" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696642 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696649 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696655 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-thanos" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696661 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696666 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf120e4-468e-4053-bd02-294c44702a9c" containerName="console" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696671 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="kube-rbac-proxy-web" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696677 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="alertmanager" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696681 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="config-reloader" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696686 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696691 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="kube-rbac-proxy-metric" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696696 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" containerName="thanos-sidecar" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696700 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d538589-51dd-4c79-8d3c-86376a551622" containerName="prom-label-proxy" Jun 14 15:01:10.697005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.696705 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da938d1c-006f-4149-885c-0a653f5a3911" containerName="console" Jun 14 15:01:10.701680 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.701664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.704589 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704558 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 15:01:10.704692 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 15:01:10.704692 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704570 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 15:01:10.704802 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 15:01:10.704802 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704561 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 15:01:10.705015 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.704971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 15:01:10.705112 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 15:01:10.705221 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 15:01:10.705292 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 15:01:10.705662 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mcj2b\"" Jun 14 15:01:10.705778 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705712 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-79s9gcfnt34vv\"" Jun 14 15:01:10.705778 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705726 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 15:01:10.705778 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 15:01:10.705925 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.705811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 15:01:10.711994 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.711967 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 15:01:10.715133 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.715114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 15:01:10.716560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.716527 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:10.768192 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768192 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768405 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfkbk\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-kube-api-access-bfkbk\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.768694 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.768599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869411 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869411 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.869642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.869578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870519 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870684 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870813 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870813 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfkbk\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-kube-api-access-bfkbk\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.870996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.871303 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.871015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.871303 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.871062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.871303 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.871073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.871303 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.871096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.871303 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.871146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.872260 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.872237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.872388 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.870723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.872675 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.872656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.872744 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.872674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.872744 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.872709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.873270 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.873154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.873363 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.873348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac73f913-45b9-4905-b12a-6e525160988e-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.873425 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.873382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.873611 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.873585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.873883 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.873841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.875337 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.875307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.875337 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.875333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.875731 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.875715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.875831 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.875811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac73f913-45b9-4905-b12a-6e525160988e-config\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.876361 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.876346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac73f913-45b9-4905-b12a-6e525160988e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:10.881787 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:10.881749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfkbk\" (UniqueName: \"kubernetes.io/projected/ac73f913-45b9-4905-b12a-6e525160988e-kube-api-access-bfkbk\") pod \"prometheus-k8s-0\" (UID: \"ac73f913-45b9-4905-b12a-6e525160988e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:11.012963 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:11.012929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:01:11.155568 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:11.155541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:01:11.157029 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:01:11.156993 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac73f913_45b9_4905_b12a_6e525160988e.slice/crio-14a98da01d508bb4c444dd934cf151819e47407402b94a9b8636c02a5e16c40f WatchSource:0}: Error finding container 14a98da01d508bb4c444dd934cf151819e47407402b94a9b8636c02a5e16c40f: Status 404 returned error can't find the container with id 14a98da01d508bb4c444dd934cf151819e47407402b94a9b8636c02a5e16c40f Jun 14 15:01:11.648816 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:11.648784 2577 generic.go:356] "Generic (PLEG): container finished" podID="ac73f913-45b9-4905-b12a-6e525160988e" containerID="21c7a1e233236866249c94ddb0f45f19bda9566b2c7ddedf589ba79acfd415a0" exitCode=0 Jun 14 15:01:11.649170 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:11.648878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerDied","Data":"21c7a1e233236866249c94ddb0f45f19bda9566b2c7ddedf589ba79acfd415a0"} Jun 14 15:01:11.649170 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:11.648938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"14a98da01d508bb4c444dd934cf151819e47407402b94a9b8636c02a5e16c40f"} Jun 14 15:01:12.393529 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.393454 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68ac0a6f-fb88-434f-99c2-6a39715828be" path="/var/lib/kubelet/pods/68ac0a6f-fb88-434f-99c2-6a39715828be/volumes" Jun 14 15:01:12.656281 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"15566a26ce5b77a3919a16c4bc88f1d1944053c68efbb8a4fe5d403061f842aa"} Jun 14 15:01:12.656281 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"6688daac25468eaae54a9cede1966c967b40d54ba8f6b10a15d75a0a89ab69c4"} Jun 14 15:01:12.656666 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"4f143ec21638ac9465cfc8bc41705e22ff56679757244dd82fbca2a87f885d12"} Jun 14 15:01:12.656666 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656314 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"4a763326ed53e05de35bf854b24b287208936fb8814160f803abd6e54e913bfa"} Jun 14 15:01:12.656666 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"9a7bd5fca1373f3b422caf8c622dd4482d261b77a8fceecaa7fe13b98983490b"} Jun 14 15:01:12.656666 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.656359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac73f913-45b9-4905-b12a-6e525160988e","Type":"ContainerStarted","Data":"9794b348d9dda4e6e6e30a4aad2e99490f0d2fe7f4468b6576d3a656d34ae141"} Jun 14 15:01:12.683586 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:12.683477 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.664265466 podStartE2EDuration="2.683460439s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.194973ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:01:12.682384265 +0000 UTC m=+344.699631795" watchObservedRunningTime="2026-06-14 15:01:12.683460439 +0000 UTC m=+344.700707955" Jun 14 15:01:16.014037 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:01:16.014003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:02:11.013377 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:02:11.013330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:02:11.029107 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:02:11.029081 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:02:11.902302 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:02:11.902271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:03:04.794060 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.794024 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-xr488"] Jun 14 15:03:04.797185 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.797166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:04.799431 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.799409 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 15:03:04.800492 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.800471 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 15:03:04.800492 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.800470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cb9qd\"" Jun 14 15:03:04.805790 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.805749 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xr488"] Jun 14 15:03:04.939742 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.939692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxfc\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-kube-api-access-rfxfc\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:04.939742 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:04.939744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-bound-sa-token\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.040683 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.040641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxfc\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-kube-api-access-rfxfc\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.040879 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.040695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-bound-sa-token\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.050146 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.050074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-bound-sa-token\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.050255 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.050142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxfc\" (UniqueName: \"kubernetes.io/projected/a316e461-a682-48b5-aae0-48f11a36dcbe-kube-api-access-rfxfc\") pod \"cert-manager-59c77684cc-xr488\" (UID: \"a316e461-a682-48b5-aae0-48f11a36dcbe\") " pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.115614 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.115581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xr488" Jun 14 15:03:05.268902 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.268868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xr488"] Jun 14 15:03:05.272074 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:03:05.272030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda316e461_a682_48b5_aae0_48f11a36dcbe.slice/crio-3d7dd308814bf24f6ae21b7f17ae9dd3e97cab9a389e6417cafb2501b61cb6a1 WatchSource:0}: Error finding container 3d7dd308814bf24f6ae21b7f17ae9dd3e97cab9a389e6417cafb2501b61cb6a1: Status 404 returned error can't find the container with id 3d7dd308814bf24f6ae21b7f17ae9dd3e97cab9a389e6417cafb2501b61cb6a1 Jun 14 15:03:05.274113 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:05.274094 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:03:06.100919 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:06.100871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xr488" event={"ID":"a316e461-a682-48b5-aae0-48f11a36dcbe","Type":"ContainerStarted","Data":"3d7dd308814bf24f6ae21b7f17ae9dd3e97cab9a389e6417cafb2501b61cb6a1"} Jun 14 15:03:09.116226 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:09.116184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xr488" event={"ID":"a316e461-a682-48b5-aae0-48f11a36dcbe","Type":"ContainerStarted","Data":"dd7c7c511110e69729988200f9eaf8b7a4d0d56ee01af0d491071282abb32fcd"} Jun 14 15:03:09.132378 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:09.132329 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-xr488" podStartSLOduration=2.266311437 podStartE2EDuration="5.132314133s" totalImagesPullingTime="2.866002696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:09.13120073 +0000 UTC m=+461.148448263" watchObservedRunningTime="2026-06-14 15:03:09.132314133 +0000 UTC m=+461.149561651" Jun 14 15:03:28.915729 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.915694 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6"] Jun 14 15:03:28.921343 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.921311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:28.926047 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.925986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 15:03:28.926463 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.926438 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-msgfl\"" Jun 14 15:03:28.926631 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.926610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 15:03:28.926731 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.926610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 15:03:28.926868 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.926844 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 15:03:28.934550 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.934520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6"] Jun 14 15:03:28.943924 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.943901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vb4v\" (UniqueName: \"kubernetes.io/projected/9d99b326-8f71-4258-80d9-d54f96040a9d-kube-api-access-4vb4v\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:28.944056 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.943938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:28.944056 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.943970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:28.944176 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.944086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:28.944270 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:28.944244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045358 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045558 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vb4v\" (UniqueName: \"kubernetes.io/projected/9d99b326-8f71-4258-80d9-d54f96040a9d-kube-api-access-4vb4v\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045558 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045558 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045558 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.045947 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.045922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.048043 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.048015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.048182 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.048161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d99b326-8f71-4258-80d9-d54f96040a9d-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.048376 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.048360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d99b326-8f71-4258-80d9-d54f96040a9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.057732 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.057713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vb4v\" (UniqueName: \"kubernetes.io/projected/9d99b326-8f71-4258-80d9-d54f96040a9d-kube-api-access-4vb4v\") pod \"opendatahub-operator-controller-manager-8b6c5698-lvxz6\" (UID: \"9d99b326-8f71-4258-80d9-d54f96040a9d\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.233805 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.233737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:29.376869 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:29.376838 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6"] Jun 14 15:03:29.380000 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:03:29.379974 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d99b326_8f71_4258_80d9_d54f96040a9d.slice/crio-4e2904ab61803f1c1bb24b5af15cae89d44e777452c4e7e6abff99620d3bb952 WatchSource:0}: Error finding container 4e2904ab61803f1c1bb24b5af15cae89d44e777452c4e7e6abff99620d3bb952: Status 404 returned error can't find the container with id 4e2904ab61803f1c1bb24b5af15cae89d44e777452c4e7e6abff99620d3bb952 Jun 14 15:03:30.203422 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:30.203379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" event={"ID":"9d99b326-8f71-4258-80d9-d54f96040a9d","Type":"ContainerStarted","Data":"4e2904ab61803f1c1bb24b5af15cae89d44e777452c4e7e6abff99620d3bb952"} Jun 14 15:03:33.218381 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:33.218346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" event={"ID":"9d99b326-8f71-4258-80d9-d54f96040a9d","Type":"ContainerStarted","Data":"3b309162f38ab5d30b0a763539113724c8a05281857fc500aa3557755eba65fd"} Jun 14 15:03:34.227399 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:34.227364 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d99b326-8f71-4258-80d9-d54f96040a9d" containerID="3b309162f38ab5d30b0a763539113724c8a05281857fc500aa3557755eba65fd" exitCode=0 Jun 14 15:03:34.227810 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:34.227410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" event={"ID":"9d99b326-8f71-4258-80d9-d54f96040a9d","Type":"ContainerDied","Data":"3b309162f38ab5d30b0a763539113724c8a05281857fc500aa3557755eba65fd"} Jun 14 15:03:35.233940 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:35.233905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" event={"ID":"9d99b326-8f71-4258-80d9-d54f96040a9d","Type":"ContainerStarted","Data":"55e55027f54184cf69a1c8a9d74089e3e57051f3c5d68a33105e679a35606a6f"} Jun 14 15:03:35.234382 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:35.234022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:35.258104 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:35.258047 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" podStartSLOduration=3.161155666 podStartE2EDuration="7.258030845s" totalImagesPullingTime="3.096133497s" totalInitContainerRuntime="1.000741682s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:35.256220835 +0000 UTC m=+487.273468379" watchObservedRunningTime="2026-06-14 15:03:35.258030845 +0000 UTC m=+487.275278364" Jun 14 15:03:46.241384 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:46.241352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-lvxz6" Jun 14 15:03:57.539445 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.539408 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk"] Jun 14 15:03:57.541512 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.541493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.544176 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.544157 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 15:03:57.544176 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.544169 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 15:03:57.545271 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.545252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 15:03:57.545390 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.545373 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fs7lb\"" Jun 14 15:03:57.545510 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.545387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:03:57.545510 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.545492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 15:03:57.552120 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.552100 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk"] Jun 14 15:03:57.692859 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.692821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-metrics-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.693037 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.692867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.693037 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.692897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8dv\" (UniqueName: \"kubernetes.io/projected/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-kube-api-access-tr8dv\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.693037 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.692950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-manager-config\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.793393 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.793298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-manager-config\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.793393 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.793364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-metrics-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.793393 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.793392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.793602 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.793410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8dv\" (UniqueName: \"kubernetes.io/projected/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-kube-api-access-tr8dv\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.794150 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.794125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-manager-config\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.795970 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.795948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-metrics-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.796153 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.796119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-cert\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.801709 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.801690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8dv\" (UniqueName: \"kubernetes.io/projected/2155d5d8-3ae5-49c3-8dd2-98998e0e1047-kube-api-access-tr8dv\") pod \"lws-controller-manager-7d55879689-b2bfk\" (UID: \"2155d5d8-3ae5-49c3-8dd2-98998e0e1047\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.850420 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.850384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:03:57.978575 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:57.978549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk"] Jun 14 15:03:57.981014 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:03:57.980985 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2155d5d8_3ae5_49c3_8dd2_98998e0e1047.slice/crio-f6d6eb975d870b8da6bcbaa1eb5be825c9f3617d67a97ebe14bbf065bbcfe85b WatchSource:0}: Error finding container f6d6eb975d870b8da6bcbaa1eb5be825c9f3617d67a97ebe14bbf065bbcfe85b: Status 404 returned error can't find the container with id f6d6eb975d870b8da6bcbaa1eb5be825c9f3617d67a97ebe14bbf065bbcfe85b Jun 14 15:03:58.332475 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:03:58.332438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" event={"ID":"2155d5d8-3ae5-49c3-8dd2-98998e0e1047","Type":"ContainerStarted","Data":"f6d6eb975d870b8da6bcbaa1eb5be825c9f3617d67a97ebe14bbf065bbcfe85b"} Jun 14 15:04:01.347624 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:01.347591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" event={"ID":"2155d5d8-3ae5-49c3-8dd2-98998e0e1047","Type":"ContainerStarted","Data":"43766d387a247d90f997aa63c2b46a5507670902d32bf84e837cd33c9f590d20"} Jun 14 15:04:01.348037 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:01.347712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:04:01.366008 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:01.365965 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" podStartSLOduration=2.013862746 podStartE2EDuration="4.365950618s" totalImagesPullingTime="2.352087872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:01.364552642 +0000 UTC m=+513.381800162" watchObservedRunningTime="2026-06-14 15:04:01.365950618 +0000 UTC m=+513.383198135" Jun 14 15:04:12.354496 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:12.354421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d55879689-b2bfk" Jun 14 15:04:33.832566 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.832528 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v"] Jun 14 15:04:33.838422 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.838396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:33.841352 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.841327 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x84m4\"" Jun 14 15:04:33.841483 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.841361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 15:04:33.841483 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.841383 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 15:04:33.842440 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.842422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 15:04:33.842513 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.842441 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 15:04:33.846857 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.846835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v"] Jun 14 15:04:33.910391 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.910350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:33.910391 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.910399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tmp\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:33.910637 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:33.910470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgm5m\" (UniqueName: \"kubernetes.io/projected/91539380-3fe4-4b55-8124-a1d37dc9ee9d-kube-api-access-rgm5m\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.011744 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.011704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tmp\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.011961 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.011752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgm5m\" (UniqueName: \"kubernetes.io/projected/91539380-3fe4-4b55-8124-a1d37dc9ee9d-kube-api-access-rgm5m\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.011961 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.011854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.013900 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.013880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tmp\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.014172 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.014155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91539380-3fe4-4b55-8124-a1d37dc9ee9d-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.021623 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.021600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgm5m\" (UniqueName: \"kubernetes.io/projected/91539380-3fe4-4b55-8124-a1d37dc9ee9d-kube-api-access-rgm5m\") pod \"kube-auth-proxy-85cfd86dcb-w496v\" (UID: \"91539380-3fe4-4b55-8124-a1d37dc9ee9d\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.150201 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.150124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" Jun 14 15:04:34.279117 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.279090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v"] Jun 14 15:04:34.281257 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:04:34.281232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91539380_3fe4_4b55_8124_a1d37dc9ee9d.slice/crio-40541d68034ad9ded95b8414e4bba453231aecb1aefcaa495c4a979126cbc2e6 WatchSource:0}: Error finding container 40541d68034ad9ded95b8414e4bba453231aecb1aefcaa495c4a979126cbc2e6: Status 404 returned error can't find the container with id 40541d68034ad9ded95b8414e4bba453231aecb1aefcaa495c4a979126cbc2e6 Jun 14 15:04:34.491844 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:34.491793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" event={"ID":"91539380-3fe4-4b55-8124-a1d37dc9ee9d","Type":"ContainerStarted","Data":"40541d68034ad9ded95b8414e4bba453231aecb1aefcaa495c4a979126cbc2e6"} Jun 14 15:04:37.510731 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:37.510695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" event={"ID":"91539380-3fe4-4b55-8124-a1d37dc9ee9d","Type":"ContainerStarted","Data":"9741cdfeff5d86a7b1db2015d22388e4304180224e8b65dd67ef865464c86c64"} Jun 14 15:04:37.527317 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:04:37.527259 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-w496v" podStartSLOduration=1.7551827549999999 podStartE2EDuration="4.527245285s" totalImagesPullingTime="2.77206253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:37.526037316 +0000 UTC m=+549.543284834" watchObservedRunningTime="2026-06-14 15:04:37.527245285 +0000 UTC m=+549.544492862" Jun 14 15:05:28.364356 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:05:28.364327 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:05:28.365138 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:05:28.365123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:06:27.383939 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.383900 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n"] Jun 14 15:06:27.386117 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.386101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.388917 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.388894 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 15:06:27.388917 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.388908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:06:27.389093 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.388911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 15:06:27.390104 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.390087 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:06:27.390104 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.390099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm2s6\"" Jun 14 15:06:27.402850 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.402825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n"] Jun 14 15:06:27.411856 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.411826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pp4c\" (UniqueName: \"kubernetes.io/projected/dc6bb847-c23a-4610-9d97-1f909dbd77d1-kube-api-access-7pp4c\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.411992 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.411914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.412054 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.411986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6bb847-c23a-4610-9d97-1f909dbd77d1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.513165 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.513127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6bb847-c23a-4610-9d97-1f909dbd77d1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.513351 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.513182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pp4c\" (UniqueName: \"kubernetes.io/projected/dc6bb847-c23a-4610-9d97-1f909dbd77d1-kube-api-access-7pp4c\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.513351 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.513293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.513442 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:06:27.513378 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 14 15:06:27.513484 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:06:27.513458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert podName:dc6bb847-c23a-4610-9d97-1f909dbd77d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:06:28.013438368 +0000 UTC m=+660.030685882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pvq9n" (UID: "dc6bb847-c23a-4610-9d97-1f909dbd77d1") : secret "plugin-serving-cert" not found Jun 14 15:06:27.513740 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.513721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6bb847-c23a-4610-9d97-1f909dbd77d1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:27.521913 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:27.521890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pp4c\" (UniqueName: \"kubernetes.io/projected/dc6bb847-c23a-4610-9d97-1f909dbd77d1-kube-api-access-7pp4c\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:28.018203 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.018173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:28.020639 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.020614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6bb847-c23a-4610-9d97-1f909dbd77d1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pvq9n\" (UID: \"dc6bb847-c23a-4610-9d97-1f909dbd77d1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:28.299693 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.299613 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm2s6\"" Jun 14 15:06:28.307888 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.307859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" Jun 14 15:06:28.442327 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.442302 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n"] Jun 14 15:06:28.444569 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:06:28.444542 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc6bb847_c23a_4610_9d97_1f909dbd77d1.slice/crio-826f52060bff8793a595e9114c1f847d7ceb82a1f2a3f64e26714cf8a1dd45aa WatchSource:0}: Error finding container 826f52060bff8793a595e9114c1f847d7ceb82a1f2a3f64e26714cf8a1dd45aa: Status 404 returned error can't find the container with id 826f52060bff8793a595e9114c1f847d7ceb82a1f2a3f64e26714cf8a1dd45aa Jun 14 15:06:28.996527 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:28.996486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" event={"ID":"dc6bb847-c23a-4610-9d97-1f909dbd77d1","Type":"ContainerStarted","Data":"826f52060bff8793a595e9114c1f847d7ceb82a1f2a3f64e26714cf8a1dd45aa"} Jun 14 15:06:37.698643 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.698604 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:06:37.703335 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.703310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.706324 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.706298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lpknv\"" Jun 14 15:06:37.727659 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.727582 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:06:37.810239 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.810204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwj6s\" (UniqueName: \"kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.810425 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.810302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.911132 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.911079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwj6s\" (UniqueName: \"kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.911327 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.911150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.911556 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.911536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:37.930717 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:37.930683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwj6s\" (UniqueName: \"kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d5frf\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:38.017805 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:38.017766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:49.982952 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:49.982913 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:06:51.694962 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:51.694924 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:06:51.697713 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:06:51.697684 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfa3870_2ea5_4af2_b1ff_3960227ea0c1.slice/crio-bec2c693f4436e7dd933cdd172c76c3f46faa5d5517f2b74267619fd3eff4602 WatchSource:0}: Error finding container bec2c693f4436e7dd933cdd172c76c3f46faa5d5517f2b74267619fd3eff4602: Status 404 returned error can't find the container with id bec2c693f4436e7dd933cdd172c76c3f46faa5d5517f2b74267619fd3eff4602 Jun 14 15:06:52.114250 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:52.114214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" event={"ID":"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1","Type":"ContainerStarted","Data":"bec2c693f4436e7dd933cdd172c76c3f46faa5d5517f2b74267619fd3eff4602"} Jun 14 15:06:52.115696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:52.115668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" event={"ID":"dc6bb847-c23a-4610-9d97-1f909dbd77d1","Type":"ContainerStarted","Data":"dfcc1ca9f87176fe03ba47f13f5853e9ecdc49e31482f9d8816cb9215861f32a"} Jun 14 15:06:52.145042 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:52.145000 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pvq9n" podStartSLOduration=1.972334113 podStartE2EDuration="25.14498488s" totalImagesPullingTime="23.172650767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:52.143958824 +0000 UTC m=+684.161206362" watchObservedRunningTime="2026-06-14 15:06:52.14498488 +0000 UTC m=+684.162232398" Jun 14 15:06:59.150101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.150018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" event={"ID":"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1","Type":"ContainerStarted","Data":"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117"} Jun 14 15:06:59.150101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.150070 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" podUID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" containerName="manager" containerID="cri-o://deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117" gracePeriod=10 Jun 14 15:06:59.150550 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.150132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:59.178186 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.178137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" podStartSLOduration=15.044768814 podStartE2EDuration="22.178125224s" totalImagesPullingTime="7.13335641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:59.177745231 +0000 UTC m=+691.194992750" watchObservedRunningTime="2026-06-14 15:06:59.178125224 +0000 UTC m=+691.195372742" Jun 14 15:06:59.553837 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.553809 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:06:59.719140 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.719107 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume\") pod \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " Jun 14 15:06:59.719318 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.719190 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwj6s\" (UniqueName: \"kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s\") pod \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\" (UID: \"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1\") " Jun 14 15:06:59.719610 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.719586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" (UID: "2bfa3870-2ea5-4af2-b1ff-3960227ea0c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:06:59.721376 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.721351 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s" (OuterVolumeSpecName: "kube-api-access-jwj6s") pod "2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" (UID: "2bfa3870-2ea5-4af2-b1ff-3960227ea0c1"). InnerVolumeSpecName "kube-api-access-jwj6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:06:59.819979 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.819941 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwj6s\" (UniqueName: \"kubernetes.io/projected/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-kube-api-access-jwj6s\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:06:59.819979 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:06:59.819971 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1-extensions-socket-volume\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:07:00.155538 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.155457 2577 generic.go:356] "Generic (PLEG): container finished" podID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" containerID="deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117" exitCode=0 Jun 14 15:07:00.155538 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.155503 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" Jun 14 15:07:00.155538 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.155524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" event={"ID":"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1","Type":"ContainerDied","Data":"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117"} Jun 14 15:07:00.156057 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.155566 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf" event={"ID":"2bfa3870-2ea5-4af2-b1ff-3960227ea0c1","Type":"ContainerDied","Data":"bec2c693f4436e7dd933cdd172c76c3f46faa5d5517f2b74267619fd3eff4602"} Jun 14 15:07:00.156057 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.155587 2577 scope.go:117] "RemoveContainer" containerID="deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117" Jun 14 15:07:00.164693 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.164674 2577 scope.go:117] "RemoveContainer" containerID="deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117" Jun 14 15:07:00.164989 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:07:00.164968 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117\": container with ID starting with deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117 not found: ID does not exist" containerID="deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117" Jun 14 15:07:00.165063 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.164997 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117"} err="failed to get container status \"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117\": rpc error: code = NotFound desc = could not find container \"deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117\": container with ID starting with deba6f6825fda539855786cd21d459fee56b06a3b0c6bf34aaf30e15c4872117 not found: ID does not exist" Jun 14 15:07:00.178831 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.178806 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:07:00.183696 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.183676 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d5frf"] Jun 14 15:07:00.394099 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:00.394070 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" path="/var/lib/kubelet/pods/2bfa3870-2ea5-4af2-b1ff-3960227ea0c1/volumes" Jun 14 15:07:08.714887 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.714848 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:08.715429 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.715399 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" containerName="manager" Jun 14 15:07:08.715504 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.715431 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" containerName="manager" Jun 14 15:07:08.715556 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.715532 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfa3870-2ea5-4af2-b1ff-3960227ea0c1" containerName="manager" Jun 14 15:07:08.782466 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.782436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:08.782619 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.782547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.786676 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.786654 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 15:07:08.797528 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.797504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.797642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.797547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw69d\" (UniqueName: \"kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.854747 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.854715 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:08.898343 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.898311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.898503 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.898370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw69d\" (UniqueName: \"kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.898995 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.898977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:08.922321 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:08.922294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw69d\" (UniqueName: \"kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d\") pod \"limitador-limitador-64c94fd64f-b54gt\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:09.093353 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:09.093264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:09.245801 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:09.245773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:09.247153 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:07:09.247124 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5788b4_4906_4d85_a5f4_17c555909d74.slice/crio-c8e6b7bbf0f97eb68c5b5c8f73ad06174049e6584db5fc196a696a492985c4ca WatchSource:0}: Error finding container c8e6b7bbf0f97eb68c5b5c8f73ad06174049e6584db5fc196a696a492985c4ca: Status 404 returned error can't find the container with id c8e6b7bbf0f97eb68c5b5c8f73ad06174049e6584db5fc196a696a492985c4ca Jun 14 15:07:10.077665 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.077626 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:07:10.081893 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.081541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:07:10.090590 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.090562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wkrcn\"" Jun 14 15:07:10.100840 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.100776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:07:10.206328 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.206291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" event={"ID":"ff5788b4-4906-4d85-a5f4-17c555909d74","Type":"ContainerStarted","Data":"c8e6b7bbf0f97eb68c5b5c8f73ad06174049e6584db5fc196a696a492985c4ca"} Jun 14 15:07:10.208085 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.208046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knx94\" (UniqueName: \"kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94\") pod \"authorino-75d556bd77-55sc6\" (UID: \"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a\") " pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:07:10.308776 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.308726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knx94\" (UniqueName: \"kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94\") pod \"authorino-75d556bd77-55sc6\" (UID: \"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a\") " pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:07:10.320223 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.320196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knx94\" (UniqueName: \"kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94\") pod \"authorino-75d556bd77-55sc6\" (UID: \"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a\") " pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:07:10.396174 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.396002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:07:10.559543 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:10.559511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:07:10.562240 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:07:10.562203 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda80c4dd2_6303_45d8_91cc_4fa5000a0b8a.slice/crio-082a88999bbe0fce236fd87f7e9924fd967bfce90fb7ba16f7df14bc52bf559f WatchSource:0}: Error finding container 082a88999bbe0fce236fd87f7e9924fd967bfce90fb7ba16f7df14bc52bf559f: Status 404 returned error can't find the container with id 082a88999bbe0fce236fd87f7e9924fd967bfce90fb7ba16f7df14bc52bf559f Jun 14 15:07:11.213348 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:11.213310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55sc6" event={"ID":"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a","Type":"ContainerStarted","Data":"082a88999bbe0fce236fd87f7e9924fd967bfce90fb7ba16f7df14bc52bf559f"} Jun 14 15:07:13.226126 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:13.226093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" event={"ID":"ff5788b4-4906-4d85-a5f4-17c555909d74","Type":"ContainerStarted","Data":"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119"} Jun 14 15:07:13.226611 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:13.226205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:13.250987 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:13.250937 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" podStartSLOduration=2.306597889 podStartE2EDuration="5.250921333s" totalImagesPullingTime="2.944323444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:13.250376467 +0000 UTC m=+705.267624014" watchObservedRunningTime="2026-06-14 15:07:13.250921333 +0000 UTC m=+705.268168887" Jun 14 15:07:14.231838 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:14.231800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55sc6" event={"ID":"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a","Type":"ContainerStarted","Data":"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60"} Jun 14 15:07:24.168481 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.168420 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-55sc6" podStartSLOduration=10.684179514 podStartE2EDuration="14.168404265s" totalImagesPullingTime="3.484224751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:14.259496196 +0000 UTC m=+706.276743734" watchObservedRunningTime="2026-06-14 15:07:24.168404265 +0000 UTC m=+716.185651783" Jun 14 15:07:24.169004 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.168815 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:24.169087 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.169046 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" podUID="ff5788b4-4906-4d85-a5f4-17c555909d74" containerName="limitador" containerID="cri-o://26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119" gracePeriod=30 Jun 14 15:07:24.169746 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.169693 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:24.714904 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.714875 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:24.845651 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.845565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file\") pod \"ff5788b4-4906-4d85-a5f4-17c555909d74\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " Jun 14 15:07:24.845651 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.845636 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw69d\" (UniqueName: \"kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d\") pod \"ff5788b4-4906-4d85-a5f4-17c555909d74\" (UID: \"ff5788b4-4906-4d85-a5f4-17c555909d74\") " Jun 14 15:07:24.845979 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.845958 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file" (OuterVolumeSpecName: "config-file") pod "ff5788b4-4906-4d85-a5f4-17c555909d74" (UID: "ff5788b4-4906-4d85-a5f4-17c555909d74"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:07:24.847747 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.847724 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d" (OuterVolumeSpecName: "kube-api-access-dw69d") pod "ff5788b4-4906-4d85-a5f4-17c555909d74" (UID: "ff5788b4-4906-4d85-a5f4-17c555909d74"). InnerVolumeSpecName "kube-api-access-dw69d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:07:24.946333 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.946299 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ff5788b4-4906-4d85-a5f4-17c555909d74-config-file\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:07:24.946333 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:24.946328 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw69d\" (UniqueName: \"kubernetes.io/projected/ff5788b4-4906-4d85-a5f4-17c555909d74-kube-api-access-dw69d\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:07:25.283197 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.283161 2577 generic.go:356] "Generic (PLEG): container finished" podID="ff5788b4-4906-4d85-a5f4-17c555909d74" containerID="26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119" exitCode=0 Jun 14 15:07:25.283197 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.283202 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" Jun 14 15:07:25.283674 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.283201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" event={"ID":"ff5788b4-4906-4d85-a5f4-17c555909d74","Type":"ContainerDied","Data":"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119"} Jun 14 15:07:25.283674 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.283339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b54gt" event={"ID":"ff5788b4-4906-4d85-a5f4-17c555909d74","Type":"ContainerDied","Data":"c8e6b7bbf0f97eb68c5b5c8f73ad06174049e6584db5fc196a696a492985c4ca"} Jun 14 15:07:25.283674 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.283366 2577 scope.go:117] "RemoveContainer" containerID="26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119" Jun 14 15:07:25.291541 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.291522 2577 scope.go:117] "RemoveContainer" containerID="26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119" Jun 14 15:07:25.291805 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:07:25.291789 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119\": container with ID starting with 26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119 not found: ID does not exist" containerID="26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119" Jun 14 15:07:25.291851 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.291815 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119"} err="failed to get container status \"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119\": rpc error: code = NotFound desc = could not find container \"26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119\": container with ID starting with 26b76ba1d4f3e7dea75ecafb73ea7dc8015a31fea081b10bef121d632ae74119 not found: ID does not exist" Jun 14 15:07:25.313011 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.312979 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:25.317100 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:25.317074 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b54gt"] Jun 14 15:07:26.394111 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:26.394077 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5788b4-4906-4d85-a5f4-17c555909d74" path="/var/lib/kubelet/pods/ff5788b4-4906-4d85-a5f4-17c555909d74/volumes" Jun 14 15:07:29.789599 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.789570 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s4b7z"] Jun 14 15:07:29.790009 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.789922 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5788b4-4906-4d85-a5f4-17c555909d74" containerName="limitador" Jun 14 15:07:29.790009 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.789934 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5788b4-4906-4d85-a5f4-17c555909d74" containerName="limitador" Jun 14 15:07:29.790009 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.790001 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5788b4-4906-4d85-a5f4-17c555909d74" containerName="limitador" Jun 14 15:07:29.793727 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.793711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:29.797038 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.797010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 15:07:29.797157 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.797136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vgt2v\"" Jun 14 15:07:29.808281 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.808254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s4b7z"] Jun 14 15:07:29.889651 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.889600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/411419fb-e9d5-4af1-a7ed-ab80da723a6b-data\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:29.889866 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.889740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kxsr\" (UniqueName: \"kubernetes.io/projected/411419fb-e9d5-4af1-a7ed-ab80da723a6b-kube-api-access-4kxsr\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:29.990409 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.990375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kxsr\" (UniqueName: \"kubernetes.io/projected/411419fb-e9d5-4af1-a7ed-ab80da723a6b-kube-api-access-4kxsr\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:29.990651 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.990441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/411419fb-e9d5-4af1-a7ed-ab80da723a6b-data\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:29.990822 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:29.990806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/411419fb-e9d5-4af1-a7ed-ab80da723a6b-data\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:30.003403 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:30.003379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kxsr\" (UniqueName: \"kubernetes.io/projected/411419fb-e9d5-4af1-a7ed-ab80da723a6b-kube-api-access-4kxsr\") pod \"postgres-69fb4594cf-s4b7z\" (UID: \"411419fb-e9d5-4af1-a7ed-ab80da723a6b\") " pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:30.103819 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:30.103682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:30.246948 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:30.246915 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s4b7z"] Jun 14 15:07:30.252088 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:07:30.252046 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411419fb_e9d5_4af1_a7ed_ab80da723a6b.slice/crio-8bebe53ad95843ef5376a94e7e99b2766c6c3aebbcf281e0098b229fe2b2e33b WatchSource:0}: Error finding container 8bebe53ad95843ef5376a94e7e99b2766c6c3aebbcf281e0098b229fe2b2e33b: Status 404 returned error can't find the container with id 8bebe53ad95843ef5376a94e7e99b2766c6c3aebbcf281e0098b229fe2b2e33b Jun 14 15:07:30.307044 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:30.307009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s4b7z" event={"ID":"411419fb-e9d5-4af1-a7ed-ab80da723a6b","Type":"ContainerStarted","Data":"8bebe53ad95843ef5376a94e7e99b2766c6c3aebbcf281e0098b229fe2b2e33b"} Jun 14 15:07:33.322766 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:33.322727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s4b7z" event={"ID":"411419fb-e9d5-4af1-a7ed-ab80da723a6b","Type":"ContainerStarted","Data":"ca118c2acf304ac85169774cec350af2c423ee16e48bed3355a2311f3ca589f4"} Jun 14 15:07:33.323245 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:33.322975 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:33.361542 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:33.361483 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s4b7z" podStartSLOduration=1.8688809819999999 podStartE2EDuration="4.361467389s" totalImagesPullingTime="2.492586407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:33.360180861 +0000 UTC m=+725.377428369" watchObservedRunningTime="2026-06-14 15:07:33.361467389 +0000 UTC m=+725.378714906" Jun 14 15:07:39.360700 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:39.360669 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s4b7z" Jun 14 15:07:54.402516 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.402482 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jtx2r"] Jun 14 15:07:54.404978 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.404955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" Jun 14 15:07:54.411858 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.411481 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 15:07:54.411858 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.411542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hg2qm\"" Jun 14 15:07:54.411858 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.411482 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 15:07:54.436219 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.436187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkphj\" (UniqueName: \"kubernetes.io/projected/048e7005-6171-45ab-bef4-fc6ecc4e4381-kube-api-access-xkphj\") pod \"keycloak-operator-d67dbbb48-jtx2r\" (UID: \"048e7005-6171-45ab-bef4-fc6ecc4e4381\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" Jun 14 15:07:54.505923 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.505885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jtx2r"] Jun 14 15:07:54.537052 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.537020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkphj\" (UniqueName: \"kubernetes.io/projected/048e7005-6171-45ab-bef4-fc6ecc4e4381-kube-api-access-xkphj\") pod \"keycloak-operator-d67dbbb48-jtx2r\" (UID: \"048e7005-6171-45ab-bef4-fc6ecc4e4381\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" Jun 14 15:07:54.549154 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.549125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkphj\" (UniqueName: \"kubernetes.io/projected/048e7005-6171-45ab-bef4-fc6ecc4e4381-kube-api-access-xkphj\") pod \"keycloak-operator-d67dbbb48-jtx2r\" (UID: \"048e7005-6171-45ab-bef4-fc6ecc4e4381\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" Jun 14 15:07:54.716443 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.716410 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" Jun 14 15:07:54.925630 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:54.925495 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jtx2r"] Jun 14 15:07:54.928520 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:07:54.928490 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048e7005_6171_45ab_bef4_fc6ecc4e4381.slice/crio-283b111f86be44b8b16c40cde25e92abf0ad1a654fb194de6aa2d39e10db1b53 WatchSource:0}: Error finding container 283b111f86be44b8b16c40cde25e92abf0ad1a654fb194de6aa2d39e10db1b53: Status 404 returned error can't find the container with id 283b111f86be44b8b16c40cde25e92abf0ad1a654fb194de6aa2d39e10db1b53 Jun 14 15:07:55.427586 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:07:55.427548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" event={"ID":"048e7005-6171-45ab-bef4-fc6ecc4e4381","Type":"ContainerStarted","Data":"283b111f86be44b8b16c40cde25e92abf0ad1a654fb194de6aa2d39e10db1b53"} Jun 14 15:08:01.457603 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:01.457571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" event={"ID":"048e7005-6171-45ab-bef4-fc6ecc4e4381","Type":"ContainerStarted","Data":"18f0c232d904ffaea4c25bdb5bb699ee64e6e65ab246bc9271c9c58223dbf148"} Jun 14 15:08:01.495003 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:01.494943 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-jtx2r" podStartSLOduration=1.38085349 podStartE2EDuration="7.494927611s" totalImagesPullingTime="6.114074121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:01.493901013 +0000 UTC m=+753.511148531" watchObservedRunningTime="2026-06-14 15:08:01.494927611 +0000 UTC m=+753.512175130" Jun 14 15:08:40.580356 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.580320 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:40.587376 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.587351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:40.591794 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.591747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:40.662719 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.662689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgmt\" (UniqueName: \"kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt\") pod \"authorino-5d4b67c446-s4qm9\" (UID: \"00603339-cba6-456d-bf2b-3f38ce35e48e\") " pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:40.763417 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.763380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgmt\" (UniqueName: \"kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt\") pod \"authorino-5d4b67c446-s4qm9\" (UID: \"00603339-cba6-456d-bf2b-3f38ce35e48e\") " pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:40.772165 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.772140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgmt\" (UniqueName: \"kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt\") pod \"authorino-5d4b67c446-s4qm9\" (UID: \"00603339-cba6-456d-bf2b-3f38ce35e48e\") " pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:40.834251 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.834165 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:40.834428 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.834416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:40.965439 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.965414 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:40.967728 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:08:40.967696 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00603339_cba6_456d_bf2b_3f38ce35e48e.slice/crio-ee116fb05cd0e393939ec9989176f750cac8ec42a25a935b4a4458018d498448 WatchSource:0}: Error finding container ee116fb05cd0e393939ec9989176f750cac8ec42a25a935b4a4458018d498448: Status 404 returned error can't find the container with id ee116fb05cd0e393939ec9989176f750cac8ec42a25a935b4a4458018d498448 Jun 14 15:08:40.969476 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.969454 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:08:40.971137 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.971119 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:08:40.973828 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.973809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:40.976268 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.976251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 15:08:40.983930 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:40.983909 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:08:41.066540 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.066502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.066705 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.066599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9wn\" (UniqueName: \"kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.167267 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.167178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.167267 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.167259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9wn\" (UniqueName: \"kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.169565 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.169540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.175371 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.175349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9wn\" (UniqueName: \"kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn\") pod \"authorino-79bd49f96b-czg9v\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.283841 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.283807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:08:41.417671 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.417649 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:08:41.420889 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:08:41.420862 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5186420d_cfff_4b31_a198_1edede49e990.slice/crio-0258ef06ba48d3c3a375ebf4f8a7028ebef4f097819d4f96964cf103f029f2a2 WatchSource:0}: Error finding container 0258ef06ba48d3c3a375ebf4f8a7028ebef4f097819d4f96964cf103f029f2a2: Status 404 returned error can't find the container with id 0258ef06ba48d3c3a375ebf4f8a7028ebef4f097819d4f96964cf103f029f2a2 Jun 14 15:08:41.633260 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.633217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bd49f96b-czg9v" event={"ID":"5186420d-cfff-4b31-a198-1edede49e990","Type":"ContainerStarted","Data":"0258ef06ba48d3c3a375ebf4f8a7028ebef4f097819d4f96964cf103f029f2a2"} Jun 14 15:08:41.634689 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.634668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" event={"ID":"00603339-cba6-456d-bf2b-3f38ce35e48e","Type":"ContainerStarted","Data":"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca"} Jun 14 15:08:41.634689 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.634678 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" podUID="00603339-cba6-456d-bf2b-3f38ce35e48e" containerName="authorino" containerID="cri-o://80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca" gracePeriod=30 Jun 14 15:08:41.635079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.634697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" event={"ID":"00603339-cba6-456d-bf2b-3f38ce35e48e","Type":"ContainerStarted","Data":"ee116fb05cd0e393939ec9989176f750cac8ec42a25a935b4a4458018d498448"} Jun 14 15:08:41.651068 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.651028 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" podStartSLOduration=1.228727488 podStartE2EDuration="1.651013151s" totalImagesPullingTime="422.285663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:41.649342996 +0000 UTC m=+793.666590515" watchObservedRunningTime="2026-06-14 15:08:41.651013151 +0000 UTC m=+793.668260670" Jun 14 15:08:41.906964 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.906939 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:41.973772 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.973735 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsgmt\" (UniqueName: \"kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt\") pod \"00603339-cba6-456d-bf2b-3f38ce35e48e\" (UID: \"00603339-cba6-456d-bf2b-3f38ce35e48e\") " Jun 14 15:08:41.975974 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:41.975948 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt" (OuterVolumeSpecName: "kube-api-access-bsgmt") pod "00603339-cba6-456d-bf2b-3f38ce35e48e" (UID: "00603339-cba6-456d-bf2b-3f38ce35e48e"). InnerVolumeSpecName "kube-api-access-bsgmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:08:42.074961 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.074866 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsgmt\" (UniqueName: \"kubernetes.io/projected/00603339-cba6-456d-bf2b-3f38ce35e48e-kube-api-access-bsgmt\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:08:42.646560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.646514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bd49f96b-czg9v" event={"ID":"5186420d-cfff-4b31-a198-1edede49e990","Type":"ContainerStarted","Data":"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8"} Jun 14 15:08:42.648041 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.648018 2577 generic.go:356] "Generic (PLEG): container finished" podID="00603339-cba6-456d-bf2b-3f38ce35e48e" containerID="80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca" exitCode=0 Jun 14 15:08:42.648144 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.648049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" event={"ID":"00603339-cba6-456d-bf2b-3f38ce35e48e","Type":"ContainerDied","Data":"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca"} Jun 14 15:08:42.648144 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.648059 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" Jun 14 15:08:42.648144 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.648078 2577 scope.go:117] "RemoveContainer" containerID="80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca" Jun 14 15:08:42.648296 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.648069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-s4qm9" event={"ID":"00603339-cba6-456d-bf2b-3f38ce35e48e","Type":"ContainerDied","Data":"ee116fb05cd0e393939ec9989176f750cac8ec42a25a935b4a4458018d498448"} Jun 14 15:08:42.656384 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.656367 2577 scope.go:117] "RemoveContainer" containerID="80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca" Jun 14 15:08:42.656636 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:08:42.656620 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca\": container with ID starting with 80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca not found: ID does not exist" containerID="80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca" Jun 14 15:08:42.656681 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.656642 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca"} err="failed to get container status \"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca\": rpc error: code = NotFound desc = could not find container \"80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca\": container with ID starting with 80f7a7a2cfb1fa0e8cefd22d09facb1275a9d4676eb3471fc896f551fcc1daca not found: ID does not exist" Jun 14 15:08:42.663259 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.663213 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79bd49f96b-czg9v" podStartSLOduration=2.336072684 podStartE2EDuration="2.663197143s" totalImagesPullingTime="327.124459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:42.662706907 +0000 UTC m=+794.679954446" watchObservedRunningTime="2026-06-14 15:08:42.663197143 +0000 UTC m=+794.680444663" Jun 14 15:08:42.680637 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.680611 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:42.687317 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.687281 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-s4qm9"] Jun 14 15:08:42.693281 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.693259 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:08:42.693446 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.693426 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-55sc6" podUID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" containerName="authorino" containerID="cri-o://432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60" gracePeriod=30 Jun 14 15:08:42.932299 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.932275 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:08:42.984521 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.984486 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knx94\" (UniqueName: \"kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94\") pod \"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a\" (UID: \"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a\") " Jun 14 15:08:42.986525 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:42.986501 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94" (OuterVolumeSpecName: "kube-api-access-knx94") pod "a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" (UID: "a80c4dd2-6303-45d8-91cc-4fa5000a0b8a"). InnerVolumeSpecName "kube-api-access-knx94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:08:43.085590 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.085559 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knx94\" (UniqueName: \"kubernetes.io/projected/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a-kube-api-access-knx94\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:08:43.654754 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.654714 2577 generic.go:356] "Generic (PLEG): container finished" podID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" containerID="432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60" exitCode=0 Jun 14 15:08:43.654754 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.654771 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55sc6" Jun 14 15:08:43.655264 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.654805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55sc6" event={"ID":"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a","Type":"ContainerDied","Data":"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60"} Jun 14 15:08:43.655264 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.654852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55sc6" event={"ID":"a80c4dd2-6303-45d8-91cc-4fa5000a0b8a","Type":"ContainerDied","Data":"082a88999bbe0fce236fd87f7e9924fd967bfce90fb7ba16f7df14bc52bf559f"} Jun 14 15:08:43.655264 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.654877 2577 scope.go:117] "RemoveContainer" containerID="432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60" Jun 14 15:08:43.663222 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.663199 2577 scope.go:117] "RemoveContainer" containerID="432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60" Jun 14 15:08:43.663464 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:08:43.663447 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60\": container with ID starting with 432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60 not found: ID does not exist" containerID="432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60" Jun 14 15:08:43.663518 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.663471 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60"} err="failed to get container status \"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60\": rpc error: code = NotFound desc = could not find container \"432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60\": container with ID starting with 432e55ff8f11f310c9f80b8506e6eb3d270f0446490616bc4a2050240150bc60 not found: ID does not exist" Jun 14 15:08:43.681299 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.681266 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:08:43.682766 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:43.682733 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55sc6"] Jun 14 15:08:44.394415 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:44.394387 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00603339-cba6-456d-bf2b-3f38ce35e48e" path="/var/lib/kubelet/pods/00603339-cba6-456d-bf2b-3f38ce35e48e/volumes" Jun 14 15:08:44.394714 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:08:44.394702 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" path="/var/lib/kubelet/pods/a80c4dd2-6303-45d8-91cc-4fa5000a0b8a/volumes" Jun 14 15:10:28.402101 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:10:28.402030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:10:28.410005 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:10:28.409981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:12:11.779460 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779426 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779801 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" containerName="authorino" Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779814 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" containerName="authorino" Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779827 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00603339-cba6-456d-bf2b-3f38ce35e48e" containerName="authorino" Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779832 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="00603339-cba6-456d-bf2b-3f38ce35e48e" containerName="authorino" Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779906 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80c4dd2-6303-45d8-91cc-4fa5000a0b8a" containerName="authorino" Jun 14 15:12:11.779915 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.779914 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="00603339-cba6-456d-bf2b-3f38ce35e48e" containerName="authorino" Jun 14 15:12:11.785310 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.785293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.788642 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.788617 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 15:12:11.799096 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.799071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:12:11.852521 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.852493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.852688 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.852537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmcs\" (UniqueName: \"kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.852688 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.852559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.953522 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.953483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmcs\" (UniqueName: \"kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.953522 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.953525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.953796 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.953635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.954355 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.954318 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.956039 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.956018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:11.962127 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:11.962105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmcs\" (UniqueName: \"kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs\") pod \"authorino-6bbfbd4dc6-fjw8v\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:12.094671 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:12.094593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:12:12.220734 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:12.220705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:12:12.222951 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:12:12.222926 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d704d78_e27a_4252_bbaa_3dae1d7e7943.slice/crio-3746de5c4f07d8d234e6184b0d20d116c8ab444abde677f9a6d56131de19a41c WatchSource:0}: Error finding container 3746de5c4f07d8d234e6184b0d20d116c8ab444abde677f9a6d56131de19a41c: Status 404 returned error can't find the container with id 3746de5c4f07d8d234e6184b0d20d116c8ab444abde677f9a6d56131de19a41c Jun 14 15:12:12.633165 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:12.633136 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" event={"ID":"7d704d78-e27a-4252-bbaa-3dae1d7e7943","Type":"ContainerStarted","Data":"3746de5c4f07d8d234e6184b0d20d116c8ab444abde677f9a6d56131de19a41c"} Jun 14 15:12:13.639411 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.639372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" event={"ID":"7d704d78-e27a-4252-bbaa-3dae1d7e7943","Type":"ContainerStarted","Data":"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519"} Jun 14 15:12:13.658871 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.658817 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" podStartSLOduration=2.281741182 podStartE2EDuration="2.658801098s" totalImagesPullingTime="377.059916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:12:13.656444416 +0000 UTC m=+1005.673691935" watchObservedRunningTime="2026-06-14 15:12:13.658801098 +0000 UTC m=+1005.676048615" Jun 14 15:12:13.689522 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.689489 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:12:13.689742 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.689703 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-79bd49f96b-czg9v" podUID="5186420d-cfff-4b31-a198-1edede49e990" containerName="authorino" containerID="cri-o://12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8" gracePeriod=30 Jun 14 15:12:13.945175 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.945143 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:12:13.971811 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.971783 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert\") pod \"5186420d-cfff-4b31-a198-1edede49e990\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " Jun 14 15:12:13.971976 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.971833 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw9wn\" (UniqueName: \"kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn\") pod \"5186420d-cfff-4b31-a198-1edede49e990\" (UID: \"5186420d-cfff-4b31-a198-1edede49e990\") " Jun 14 15:12:13.973828 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.973795 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn" (OuterVolumeSpecName: "kube-api-access-dw9wn") pod "5186420d-cfff-4b31-a198-1edede49e990" (UID: "5186420d-cfff-4b31-a198-1edede49e990"). InnerVolumeSpecName "kube-api-access-dw9wn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:12:13.981646 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:13.981622 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5186420d-cfff-4b31-a198-1edede49e990" (UID: "5186420d-cfff-4b31-a198-1edede49e990"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:12:14.072427 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.072393 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5186420d-cfff-4b31-a198-1edede49e990-tls-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:12:14.072427 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.072420 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw9wn\" (UniqueName: \"kubernetes.io/projected/5186420d-cfff-4b31-a198-1edede49e990-kube-api-access-dw9wn\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:12:14.645095 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.645062 2577 generic.go:356] "Generic (PLEG): container finished" podID="5186420d-cfff-4b31-a198-1edede49e990" containerID="12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8" exitCode=0 Jun 14 15:12:14.645579 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.645109 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bd49f96b-czg9v" Jun 14 15:12:14.645579 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.645155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bd49f96b-czg9v" event={"ID":"5186420d-cfff-4b31-a198-1edede49e990","Type":"ContainerDied","Data":"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8"} Jun 14 15:12:14.645579 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.645197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bd49f96b-czg9v" event={"ID":"5186420d-cfff-4b31-a198-1edede49e990","Type":"ContainerDied","Data":"0258ef06ba48d3c3a375ebf4f8a7028ebef4f097819d4f96964cf103f029f2a2"} Jun 14 15:12:14.645579 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.645215 2577 scope.go:117] "RemoveContainer" containerID="12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8" Jun 14 15:12:14.653527 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.653498 2577 scope.go:117] "RemoveContainer" containerID="12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8" Jun 14 15:12:14.653810 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:12:14.653786 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8\": container with ID starting with 12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8 not found: ID does not exist" containerID="12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8" Jun 14 15:12:14.653913 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.653815 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8"} err="failed to get container status \"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8\": rpc error: code = NotFound desc = could not find container \"12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8\": container with ID starting with 12641a4aeac50e42893dc9c2cb90d9025a33e1833fdccb8c7a4bf3baa916b5b8 not found: ID does not exist" Jun 14 15:12:14.668902 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.668875 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:12:14.682686 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:14.682665 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79bd49f96b-czg9v"] Jun 14 15:12:16.393992 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:12:16.393960 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5186420d-cfff-4b31-a198-1edede49e990" path="/var/lib/kubelet/pods/5186420d-cfff-4b31-a198-1edede49e990/volumes" Jun 14 15:15:00.149309 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.149271 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-btqbr"] Jun 14 15:15:00.149831 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.149605 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5186420d-cfff-4b31-a198-1edede49e990" containerName="authorino" Jun 14 15:15:00.149831 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.149616 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5186420d-cfff-4b31-a198-1edede49e990" containerName="authorino" Jun 14 15:15:00.149831 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.149680 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5186420d-cfff-4b31-a198-1edede49e990" containerName="authorino" Jun 14 15:15:00.152596 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.152580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:00.156090 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.156066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8jw98\"" Jun 14 15:15:00.162972 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.162951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-btqbr"] Jun 14 15:15:00.229293 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.229256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5j8m\" (UniqueName: \"kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m\") pod \"maas-api-key-cleanup-29690835-btqbr\" (UID: \"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f\") " pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:00.329778 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.329735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5j8m\" (UniqueName: \"kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m\") pod \"maas-api-key-cleanup-29690835-btqbr\" (UID: \"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f\") " pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:00.338539 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.338511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5j8m\" (UniqueName: \"kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m\") pod \"maas-api-key-cleanup-29690835-btqbr\" (UID: \"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f\") " pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:00.463457 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.463427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:00.616378 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.616348 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690835-btqbr"] Jun 14 15:15:00.617534 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:15:00.617499 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3d14e7_bd0a_4389_bd92_e423da0a1f8f.slice/crio-5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c WatchSource:0}: Error finding container 5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c: Status 404 returned error can't find the container with id 5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c Jun 14 15:15:00.619428 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:00.619411 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:15:01.409583 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:01.409538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" event={"ID":"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f","Type":"ContainerStarted","Data":"5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c"} Jun 14 15:15:03.420199 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:03.420160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" event={"ID":"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f","Type":"ContainerStarted","Data":"968f7c70adb2bc5784127071a35ce25a71fe0101efac04a78e72a7d07a61e430"} Jun 14 15:15:03.443516 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:03.443467 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" podStartSLOduration=1.091252054 podStartE2EDuration="3.443451916s" totalImagesPullingTime="2.352199862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:03.441688189 +0000 UTC m=+1175.458935707" watchObservedRunningTime="2026-06-14 15:15:03.443451916 +0000 UTC m=+1175.460699433" Jun 14 15:15:04.426739 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:04.426703 2577 generic.go:356] "Generic (PLEG): container finished" podID="5e3d14e7-bd0a-4389-bd92-e423da0a1f8f" containerID="968f7c70adb2bc5784127071a35ce25a71fe0101efac04a78e72a7d07a61e430" exitCode=0 Jun 14 15:15:04.427224 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:04.426749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" event={"ID":"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f","Type":"ContainerDied","Data":"968f7c70adb2bc5784127071a35ce25a71fe0101efac04a78e72a7d07a61e430"} Jun 14 15:15:05.560140 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:05.560116 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:05.681088 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:05.681055 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5j8m\" (UniqueName: \"kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m\") pod \"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f\" (UID: \"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f\") " Jun 14 15:15:05.683216 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:05.683150 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m" (OuterVolumeSpecName: "kube-api-access-f5j8m") pod "5e3d14e7-bd0a-4389-bd92-e423da0a1f8f" (UID: "5e3d14e7-bd0a-4389-bd92-e423da0a1f8f"). InnerVolumeSpecName "kube-api-access-f5j8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:15:05.782562 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:05.782530 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5j8m\" (UniqueName: \"kubernetes.io/projected/5e3d14e7-bd0a-4389-bd92-e423da0a1f8f-kube-api-access-f5j8m\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:15:06.437366 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:06.437336 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" Jun 14 15:15:06.437536 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:06.437329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690835-btqbr" event={"ID":"5e3d14e7-bd0a-4389-bd92-e423da0a1f8f","Type":"ContainerDied","Data":"5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c"} Jun 14 15:15:06.437536 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:06.437457 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cc93af8f745b80baae065d968aa5a728d9c351d9ce63419b0a46243b993fa9c" Jun 14 15:15:28.434373 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:28.434340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:15:28.440611 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:15:28.440581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:16:00.270616 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.270583 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64d6f7cd69-gdn4p"] Jun 14 15:16:00.271110 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.270924 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3d14e7-bd0a-4389-bd92-e423da0a1f8f" containerName="cleanup" Jun 14 15:16:00.271110 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.270935 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3d14e7-bd0a-4389-bd92-e423da0a1f8f" containerName="cleanup" Jun 14 15:16:00.271110 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.271003 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3d14e7-bd0a-4389-bd92-e423da0a1f8f" containerName="cleanup" Jun 14 15:16:00.273584 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.273567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.282721 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.282692 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64d6f7cd69-gdn4p"] Jun 14 15:16:00.449255 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.449222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-oidc-ca\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.449449 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.449265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnn6\" (UniqueName: \"kubernetes.io/projected/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-kube-api-access-4jnn6\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.449449 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.449375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-tls-cert\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.550722 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.550614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-oidc-ca\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.550925 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.550827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnn6\" (UniqueName: \"kubernetes.io/projected/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-kube-api-access-4jnn6\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.551032 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.551006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-tls-cert\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.551425 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.551403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-oidc-ca\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.553375 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.553359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-tls-cert\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.559510 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.559488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnn6\" (UniqueName: \"kubernetes.io/projected/02f4381f-fa5e-46a4-b9e4-2eaafdf0d143-kube-api-access-4jnn6\") pod \"authorino-64d6f7cd69-gdn4p\" (UID: \"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143\") " pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.584088 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.584064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" Jun 14 15:16:00.718190 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:00.718164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64d6f7cd69-gdn4p"] Jun 14 15:16:00.720017 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:16:00.719988 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02f4381f_fa5e_46a4_b9e4_2eaafdf0d143.slice/crio-007184969cefcfd003996438cddf7446a453f27bcd5a617bb8d6ff10622b25e5 WatchSource:0}: Error finding container 007184969cefcfd003996438cddf7446a453f27bcd5a617bb8d6ff10622b25e5: Status 404 returned error can't find the container with id 007184969cefcfd003996438cddf7446a453f27bcd5a617bb8d6ff10622b25e5 Jun 14 15:16:01.696486 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:01.696442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" event={"ID":"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143","Type":"ContainerStarted","Data":"126416ffe01f3eb9416fcf6ab301b060793047d4b89b07238ef93f236fcacaea"} Jun 14 15:16:01.696878 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:01.696502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" event={"ID":"02f4381f-fa5e-46a4-b9e4-2eaafdf0d143","Type":"ContainerStarted","Data":"007184969cefcfd003996438cddf7446a453f27bcd5a617bb8d6ff10622b25e5"} Jun 14 15:16:01.720128 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:01.720070 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64d6f7cd69-gdn4p" podStartSLOduration=1.353821499 podStartE2EDuration="1.720045783s" totalImagesPullingTime="366.224284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:16:01.717911254 +0000 UTC m=+1233.735158776" watchObservedRunningTime="2026-06-14 15:16:01.720045783 +0000 UTC m=+1233.737293315" Jun 14 15:16:01.754444 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:01.754398 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:16:01.754632 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:01.754569 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" podUID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" containerName="authorino" containerID="cri-o://7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519" gracePeriod=30 Jun 14 15:16:02.022585 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.022551 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:16:02.167960 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.167926 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqmcs\" (UniqueName: \"kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs\") pod \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " Jun 14 15:16:02.168128 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.168057 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert\") pod \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " Jun 14 15:16:02.168172 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.168154 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca\") pod \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\" (UID: \"7d704d78-e27a-4252-bbaa-3dae1d7e7943\") " Jun 14 15:16:02.170105 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.170070 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs" (OuterVolumeSpecName: "kube-api-access-pqmcs") pod "7d704d78-e27a-4252-bbaa-3dae1d7e7943" (UID: "7d704d78-e27a-4252-bbaa-3dae1d7e7943"). InnerVolumeSpecName "kube-api-access-pqmcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:16:02.172811 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.172784 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "7d704d78-e27a-4252-bbaa-3dae1d7e7943" (UID: "7d704d78-e27a-4252-bbaa-3dae1d7e7943"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:16:02.178596 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.178569 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7d704d78-e27a-4252-bbaa-3dae1d7e7943" (UID: "7d704d78-e27a-4252-bbaa-3dae1d7e7943"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:16:02.269079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.269005 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d704d78-e27a-4252-bbaa-3dae1d7e7943-tls-cert\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:16:02.269079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.269032 2577 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d704d78-e27a-4252-bbaa-3dae1d7e7943-oidc-ca\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:16:02.269079 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.269043 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqmcs\" (UniqueName: \"kubernetes.io/projected/7d704d78-e27a-4252-bbaa-3dae1d7e7943-kube-api-access-pqmcs\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:16:02.708113 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.708077 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" containerID="7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519" exitCode=0 Jun 14 15:16:02.708573 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.708138 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" Jun 14 15:16:02.708573 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.708169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" event={"ID":"7d704d78-e27a-4252-bbaa-3dae1d7e7943","Type":"ContainerDied","Data":"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519"} Jun 14 15:16:02.708573 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.708217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbfbd4dc6-fjw8v" event={"ID":"7d704d78-e27a-4252-bbaa-3dae1d7e7943","Type":"ContainerDied","Data":"3746de5c4f07d8d234e6184b0d20d116c8ab444abde677f9a6d56131de19a41c"} Jun 14 15:16:02.708573 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.708238 2577 scope.go:117] "RemoveContainer" containerID="7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519" Jun 14 15:16:02.716689 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.716657 2577 scope.go:117] "RemoveContainer" containerID="7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519" Jun 14 15:16:02.717018 ip-10-0-139-109 kubenswrapper[2577]: E0614 15:16:02.716990 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519\": container with ID starting with 7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519 not found: ID does not exist" containerID="7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519" Jun 14 15:16:02.717091 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.717030 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519"} err="failed to get container status \"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519\": rpc error: code = NotFound desc = could not find container \"7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519\": container with ID starting with 7d843f3c80ff492ce0d40fcbdf6d67cfeacbff827e8819c7472a50e156e2f519 not found: ID does not exist" Jun 14 15:16:02.730683 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.730658 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:16:02.735296 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:02.735277 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bbfbd4dc6-fjw8v"] Jun 14 15:16:04.393974 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:16:04.393944 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" path="/var/lib/kubelet/pods/7d704d78-e27a-4252-bbaa-3dae1d7e7943/volumes" Jun 14 15:20:28.462558 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:20:28.462529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:20:28.469844 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:20:28.469823 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:25:28.496632 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:25:28.496599 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:25:28.504066 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:25:28.504047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:30:00.136110 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.136070 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690850-l5ccl"] Jun 14 15:30:00.136586 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.136481 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" containerName="authorino" Jun 14 15:30:00.136586 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.136493 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" containerName="authorino" Jun 14 15:30:00.136586 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.136557 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d704d78-e27a-4252-bbaa-3dae1d7e7943" containerName="authorino" Jun 14 15:30:00.139541 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.139524 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:00.142882 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.142858 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8jw98\"" Jun 14 15:30:00.149095 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.149072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690850-l5ccl"] Jun 14 15:30:00.231595 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.231560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5q5s\" (UniqueName: \"kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s\") pod \"maas-api-key-cleanup-29690850-l5ccl\" (UID: \"0eec4646-4932-4b4d-94f1-6c588aaee4b6\") " pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:00.332959 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.332919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5q5s\" (UniqueName: \"kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s\") pod \"maas-api-key-cleanup-29690850-l5ccl\" (UID: \"0eec4646-4932-4b4d-94f1-6c588aaee4b6\") " pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:00.342017 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.341979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5q5s\" (UniqueName: \"kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s\") pod \"maas-api-key-cleanup-29690850-l5ccl\" (UID: \"0eec4646-4932-4b4d-94f1-6c588aaee4b6\") " pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:00.450901 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.450821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:00.579672 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.579648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690850-l5ccl"] Jun 14 15:30:00.581479 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:30:00.581449 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eec4646_4932_4b4d_94f1_6c588aaee4b6.slice/crio-42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59 WatchSource:0}: Error finding container 42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59: Status 404 returned error can't find the container with id 42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59 Jun 14 15:30:00.593110 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:00.593088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" event={"ID":"0eec4646-4932-4b4d-94f1-6c588aaee4b6","Type":"ContainerStarted","Data":"42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59"} Jun 14 15:30:01.599654 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:01.599622 2577 generic.go:356] "Generic (PLEG): container finished" podID="0eec4646-4932-4b4d-94f1-6c588aaee4b6" containerID="bc598727e5853ade5271cc87ccd31e5af015e0ef42d8ed3912ed013139ce5522" exitCode=0 Jun 14 15:30:01.600052 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:01.599669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" event={"ID":"0eec4646-4932-4b4d-94f1-6c588aaee4b6","Type":"ContainerDied","Data":"bc598727e5853ade5271cc87ccd31e5af015e0ef42d8ed3912ed013139ce5522"} Jun 14 15:30:02.731919 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:02.731896 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:02.852856 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:02.852819 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5q5s\" (UniqueName: \"kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s\") pod \"0eec4646-4932-4b4d-94f1-6c588aaee4b6\" (UID: \"0eec4646-4932-4b4d-94f1-6c588aaee4b6\") " Jun 14 15:30:02.854980 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:02.854919 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s" (OuterVolumeSpecName: "kube-api-access-p5q5s") pod "0eec4646-4932-4b4d-94f1-6c588aaee4b6" (UID: "0eec4646-4932-4b4d-94f1-6c588aaee4b6"). InnerVolumeSpecName "kube-api-access-p5q5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:30:02.953989 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:02.953960 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5q5s\" (UniqueName: \"kubernetes.io/projected/0eec4646-4932-4b4d-94f1-6c588aaee4b6-kube-api-access-p5q5s\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:30:03.609826 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:03.609790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" event={"ID":"0eec4646-4932-4b4d-94f1-6c588aaee4b6","Type":"ContainerDied","Data":"42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59"} Jun 14 15:30:03.609826 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:03.609811 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690850-l5ccl" Jun 14 15:30:03.610044 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:03.609847 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42dcc91b9a43414443fe237c092f88bdf991baabf28ebab7a0efa66e4beefc59" Jun 14 15:30:28.524591 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:28.524562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:30:28.533396 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:30:28.533379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:35:28.561019 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:35:28.560992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:35:28.571267 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:35:28.571232 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:40:28.591606 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:40:28.591503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:40:28.601305 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:40:28.601281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkpqm_f7e60f1d-530d-4508-8c77-5afccfb9e35d/ovn-acl-logging/0.log" Jun 14 15:44:30.168556 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:30.168527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64d6f7cd69-gdn4p_02f4381f-fa5e-46a4-b9e4-2eaafdf0d143/authorino/0.log" Jun 14 15:44:35.443323 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:35.443292 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690835-btqbr_5e3d14e7-bd0a-4389-bd92-e423da0a1f8f/cleanup/0.log" Jun 14 15:44:35.556107 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:35.556080 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690850-l5ccl_0eec4646-4932-4b4d-94f1-6c588aaee4b6/cleanup/0.log" Jun 14 15:44:36.150448 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:36.150418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-lvxz6_9d99b326-8f71-4258-80d9-d54f96040a9d/copy-manifests/0.log" Jun 14 15:44:36.158608 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:36.158574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-lvxz6_9d99b326-8f71-4258-80d9-d54f96040a9d/manager/0.log" Jun 14 15:44:36.422625 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:36.422527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s4b7z_411419fb-e9d5-4af1-a7ed-ab80da723a6b/postgres/0.log" Jun 14 15:44:37.736894 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:37.736858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64d6f7cd69-gdn4p_02f4381f-fa5e-46a4-b9e4-2eaafdf0d143/authorino/0.log" Jun 14 15:44:38.084709 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:38.084630 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pvq9n_dc6bb847-c23a-4610-9d97-1f909dbd77d1/kuadrant-console-plugin/0.log" Jun 14 15:44:39.261143 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:39.261108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-w496v_91539380-3fe4-4b55-8124-a1d37dc9ee9d/kube-auth-proxy/0.log" Jun 14 15:44:45.198068 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.197971 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z9pc6/must-gather-9crbh"] Jun 14 15:44:45.198523 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.198479 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eec4646-4932-4b4d-94f1-6c588aaee4b6" containerName="cleanup" Jun 14 15:44:45.198523 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.198499 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eec4646-4932-4b4d-94f1-6c588aaee4b6" containerName="cleanup" Jun 14 15:44:45.198643 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.198599 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eec4646-4932-4b4d-94f1-6c588aaee4b6" containerName="cleanup" Jun 14 15:44:45.201937 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.201913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.204860 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.204837 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"openshift-service-ca.crt\"" Jun 14 15:44:45.205129 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.205106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"kube-root-ca.crt\"" Jun 14 15:44:45.206055 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.206031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z9pc6\"/\"default-dockercfg-fng5t\"" Jun 14 15:44:45.210787 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.210753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/must-gather-9crbh"] Jun 14 15:44:45.281820 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.281789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmpk\" (UniqueName: \"kubernetes.io/projected/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-kube-api-access-rvmpk\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.282003 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.281854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-must-gather-output\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.382887 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.382840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-must-gather-output\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.383082 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.382955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmpk\" (UniqueName: \"kubernetes.io/projected/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-kube-api-access-rvmpk\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.383238 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.383216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-must-gather-output\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.392296 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.392265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmpk\" (UniqueName: \"kubernetes.io/projected/9b8cd16c-3bea-49ca-bbab-8142c0b393ac-kube-api-access-rvmpk\") pod \"must-gather-9crbh\" (UID: \"9b8cd16c-3bea-49ca-bbab-8142c0b393ac\") " pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.511860 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.511830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/must-gather-9crbh" Jun 14 15:44:45.651936 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.651909 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/must-gather-9crbh"] Jun 14 15:44:45.654178 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:44:45.654152 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b8cd16c_3bea_49ca_bbab_8142c0b393ac.slice/crio-c75fef0fb567fc3d3f16537af2c1ff94e93063effdab89d5a731077dffc14672 WatchSource:0}: Error finding container c75fef0fb567fc3d3f16537af2c1ff94e93063effdab89d5a731077dffc14672: Status 404 returned error can't find the container with id c75fef0fb567fc3d3f16537af2c1ff94e93063effdab89d5a731077dffc14672 Jun 14 15:44:45.656051 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.656031 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:44:45.668207 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:45.668181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/must-gather-9crbh" event={"ID":"9b8cd16c-3bea-49ca-bbab-8142c0b393ac","Type":"ContainerStarted","Data":"c75fef0fb567fc3d3f16537af2c1ff94e93063effdab89d5a731077dffc14672"} Jun 14 15:44:46.679950 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:46.679897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/must-gather-9crbh" event={"ID":"9b8cd16c-3bea-49ca-bbab-8142c0b393ac","Type":"ContainerStarted","Data":"270387d0d80ca6a5cc81a836c0aff508539fdad82b4944b5ec226ec52c434206"} Jun 14 15:44:46.679950 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:46.679954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/must-gather-9crbh" event={"ID":"9b8cd16c-3bea-49ca-bbab-8142c0b393ac","Type":"ContainerStarted","Data":"49abc9fd6cd04f5df1bb082f2bdc7b384fc02ed593e9800794fb274c285029ac"} Jun 14 15:44:46.696667 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:46.696578 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z9pc6/must-gather-9crbh" podStartSLOduration=0.917205247 podStartE2EDuration="1.696562219s" totalImagesPullingTime="779.356972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:44:46.695353528 +0000 UTC m=+2958.712601046" watchObservedRunningTime="2026-06-14 15:44:46.696562219 +0000 UTC m=+2958.713809736" Jun 14 15:44:48.248468 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:48.248426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dr4nv_cbd6e59e-2c19-493b-af89-15040d3f2255/global-pull-secret-syncer/0.log" Jun 14 15:44:48.430218 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:48.430175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l5lc7_0d8f56dc-537c-4ed4-a6c9-32193355985d/konnectivity-agent/0.log" Jun 14 15:44:48.552874 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:48.552783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-109.ec2.internal_3b053dcc90cae7a258548b856c1018fc/haproxy/0.log" Jun 14 15:44:53.752519 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:53.752437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64d6f7cd69-gdn4p_02f4381f-fa5e-46a4-b9e4-2eaafdf0d143/authorino/0.log" Jun 14 15:44:53.874717 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:53.874683 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pvq9n_dc6bb847-c23a-4610-9d97-1f909dbd77d1/kuadrant-console-plugin/0.log" Jun 14 15:44:55.898282 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:55.898237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-d2md2_52e26d83-2f81-44da-9a19-829e2c75a066/cluster-monitoring-operator/0.log" Jun 14 15:44:55.933060 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:55.933021 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8kjkc_81eb82c7-dd13-40d6-a323-304272d37a7f/kube-state-metrics/0.log" Jun 14 15:44:55.960139 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:55.960089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8kjkc_81eb82c7-dd13-40d6-a323-304272d37a7f/kube-rbac-proxy-main/0.log" Jun 14 15:44:55.985806 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:55.985772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8kjkc_81eb82c7-dd13-40d6-a323-304272d37a7f/kube-rbac-proxy-self/0.log" Jun 14 15:44:56.015996 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.015958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58b6656496-4hqxq_1134bcb3-955a-43c6-8ebd-29568d9744e2/metrics-server/0.log" Jun 14 15:44:56.316081 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.316049 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7wd4_94edfd2d-f4f0-4240-ac13-bd2d0cfd4463/node-exporter/0.log" Jun 14 15:44:56.343010 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.342982 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7wd4_94edfd2d-f4f0-4240-ac13-bd2d0cfd4463/kube-rbac-proxy/0.log" Jun 14 15:44:56.372467 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.372436 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7wd4_94edfd2d-f4f0-4240-ac13-bd2d0cfd4463/init-textfile/0.log" Jun 14 15:44:56.415804 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.415722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-69kzr_da2a66eb-b134-493a-a8c5-115edc0cb60a/kube-rbac-proxy-main/0.log" Jun 14 15:44:56.446647 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.446610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-69kzr_da2a66eb-b134-493a-a8c5-115edc0cb60a/kube-rbac-proxy-self/0.log" Jun 14 15:44:56.472777 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.472728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-69kzr_da2a66eb-b134-493a-a8c5-115edc0cb60a/openshift-state-metrics/0.log" Jun 14 15:44:56.514082 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.514003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/prometheus/0.log" Jun 14 15:44:56.538676 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.538595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/config-reloader/0.log" Jun 14 15:44:56.567569 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.567524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/thanos-sidecar/0.log" Jun 14 15:44:56.602582 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.602534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/kube-rbac-proxy-web/0.log" Jun 14 15:44:56.625678 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.625641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/kube-rbac-proxy/0.log" Jun 14 15:44:56.657592 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.657560 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/kube-rbac-proxy-thanos/0.log" Jun 14 15:44:56.686383 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:56.686343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac73f913-45b9-4905-b12a-6e525160988e/init-config-reloader/0.log" Jun 14 15:44:58.233407 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:44:58.233366 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-nqmjr_1db4ce8a-66a6-4b50-bb11-a7ab493d8861/networking-console-plugin/0.log" Jun 14 15:45:00.136553 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.136503 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2"] Jun 14 15:45:00.156654 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.155085 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690865-p9pk2"] Jun 14 15:45:00.156654 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.155572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.159997 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.159646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2"] Jun 14 15:45:00.159997 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.159751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:00.164521 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.164496 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8jw98\"" Jun 14 15:45:00.171106 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.171080 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690865-p9pk2"] Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-podres\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-sys\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9qw\" (UniqueName: \"kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw\") pod \"maas-api-key-cleanup-29690865-p9pk2\" (UID: \"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d\") " pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-lib-modules\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54c6\" (UniqueName: \"kubernetes.io/projected/fc26e63a-41b4-4374-807b-36b743e3d695-kube-api-access-l54c6\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.245560 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.245165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-proc\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.324540 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.324509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-5dbk6_bdb4d705-d48a-44a4-ba28-b6fe21376c33/volume-data-source-validator/0.log" Jun 14 15:45:00.345980 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.345948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-podres\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.345996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-sys\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9qw\" (UniqueName: \"kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw\") pod \"maas-api-key-cleanup-29690865-p9pk2\" (UID: \"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d\") " pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-lib-modules\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54c6\" (UniqueName: \"kubernetes.io/projected/fc26e63a-41b4-4374-807b-36b743e3d695-kube-api-access-l54c6\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-proc\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-podres\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346161 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-sys\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346497 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-proc\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.346497 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.346268 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc26e63a-41b4-4374-807b-36b743e3d695-lib-modules\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.355428 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.355399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9qw\" (UniqueName: \"kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw\") pod \"maas-api-key-cleanup-29690865-p9pk2\" (UID: \"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d\") " pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:00.356576 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.356547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54c6\" (UniqueName: \"kubernetes.io/projected/fc26e63a-41b4-4374-807b-36b743e3d695-kube-api-access-l54c6\") pod \"perf-node-gather-daemonset-sxld2\" (UID: \"fc26e63a-41b4-4374-807b-36b743e3d695\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.472987 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.472945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.486794 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.486737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:00.662102 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.662050 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2"] Jun 14 15:45:00.699170 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.699141 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690865-p9pk2"] Jun 14 15:45:00.703201 ip-10-0-139-109 kubenswrapper[2577]: W0614 15:45:00.703175 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4df44b_36bb_4a64_9c36_f5d8ce919a2d.slice/crio-ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd WatchSource:0}: Error finding container ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd: Status 404 returned error can't find the container with id ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd Jun 14 15:45:00.798769 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.798723 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" event={"ID":"fc26e63a-41b4-4374-807b-36b743e3d695","Type":"ContainerStarted","Data":"ddd7a5c15020cdd3b53d08b32d7086df0415b2368ec89688841f8e2620e0fa28"} Jun 14 15:45:00.798938 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.798800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" event={"ID":"fc26e63a-41b4-4374-807b-36b743e3d695","Type":"ContainerStarted","Data":"8e51c4ea4cda1b7345797cfb34cf7e6c22dd26b069b475f40d92bad44d0f0724"} Jun 14 15:45:00.798938 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.798911 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:00.800118 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.800095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" event={"ID":"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d","Type":"ContainerStarted","Data":"ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd"} Jun 14 15:45:00.817500 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:00.817454 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" podStartSLOduration=0.817437094 podStartE2EDuration="817.437094ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:45:00.815403322 +0000 UTC m=+2972.832650839" watchObservedRunningTime="2026-06-14 15:45:00.817437094 +0000 UTC m=+2972.834684613" Jun 14 15:45:01.682972 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:01.682937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5vxz_3235f6e0-17e1-4ecc-93f0-31c4643c9d94/dns/0.log" Jun 14 15:45:01.723813 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:01.723778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5vxz_3235f6e0-17e1-4ecc-93f0-31c4643c9d94/kube-rbac-proxy/0.log" Jun 14 15:45:01.807128 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:01.807091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" event={"ID":"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d","Type":"ContainerStarted","Data":"110dca0555d49055f1d3ac6ca7e9703518d5c132751170c57c8be4477b3b9ce2"} Jun 14 15:45:01.825754 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:01.825691 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" podStartSLOduration=1.8256764109999999 podStartE2EDuration="1.825676411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:45:01.823655908 +0000 UTC m=+2973.840903449" watchObservedRunningTime="2026-06-14 15:45:01.825676411 +0000 UTC m=+2973.842923928" Jun 14 15:45:01.849210 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:01.849188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-88562_2ef30188-47a8-43ae-9ec9-411f7998c2d0/dns-node-resolver/0.log" Jun 14 15:45:02.504032 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:02.503993 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7645cd7dfb-f2hj6_591befad-2872-424b-aeb4-f69b25a10948/registry/0.log" Jun 14 15:45:02.520476 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:02.520444 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7645cd7dfb-f2hj6_591befad-2872-424b-aeb4-f69b25a10948/registry/1.log" Jun 14 15:45:02.589991 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:02.589959 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqkws_317cfac5-b421-41f2-bfa1-f4b165180a51/node-ca/0.log" Jun 14 15:45:02.813913 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:02.813830 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f4df44b-36bb-4a64-9c36-f5d8ce919a2d" containerID="110dca0555d49055f1d3ac6ca7e9703518d5c132751170c57c8be4477b3b9ce2" exitCode=0 Jun 14 15:45:02.813913 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:02.813883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" event={"ID":"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d","Type":"ContainerDied","Data":"110dca0555d49055f1d3ac6ca7e9703518d5c132751170c57c8be4477b3b9ce2"} Jun 14 15:45:03.742847 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:03.742818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-w496v_91539380-3fe4-4b55-8124-a1d37dc9ee9d/kube-auth-proxy/0.log" Jun 14 15:45:03.981054 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:03.981029 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:04.089212 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.089128 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq9qw\" (UniqueName: \"kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw\") pod \"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d\" (UID: \"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d\") " Jun 14 15:45:04.095824 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.095789 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw" (OuterVolumeSpecName: "kube-api-access-xq9qw") pod "5f4df44b-36bb-4a64-9c36-f5d8ce919a2d" (UID: "5f4df44b-36bb-4a64-9c36-f5d8ce919a2d"). InnerVolumeSpecName "kube-api-access-xq9qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:45:04.190801 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.190745 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq9qw\" (UniqueName: \"kubernetes.io/projected/5f4df44b-36bb-4a64-9c36-f5d8ce919a2d-kube-api-access-xq9qw\") on node \"ip-10-0-139-109.ec2.internal\" DevicePath \"\"" Jun 14 15:45:04.684431 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.684358 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlpxm_33b5b70f-f79c-4a8e-9990-9708adad8f45/serve-healthcheck-canary/0.log" Jun 14 15:45:04.827913 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.827876 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" Jun 14 15:45:04.828164 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.828128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690865-p9pk2" event={"ID":"5f4df44b-36bb-4a64-9c36-f5d8ce919a2d","Type":"ContainerDied","Data":"ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd"} Jun 14 15:45:04.828312 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:04.828192 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae6cefa3d40aa821bb10f262928eb02da11cc26d4c25a88bfa4bb188ffb297fd" Jun 14 15:45:05.284572 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:05.284536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-p2b9z_6c3dce43-c768-4895-b6d4-1a329369ee38/insights-operator/0.log" Jun 14 15:45:05.286244 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:05.286219 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-p2b9z_6c3dce43-c768-4895-b6d4-1a329369ee38/insights-operator/1.log" Jun 14 15:45:05.313113 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:05.313073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92bvs_c90a75b2-f727-43de-873a-e025e978e27e/kube-rbac-proxy/0.log" Jun 14 15:45:05.338043 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:05.338012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92bvs_c90a75b2-f727-43de-873a-e025e978e27e/exporter/0.log" Jun 14 15:45:05.365498 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:05.365469 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92bvs_c90a75b2-f727-43de-873a-e025e978e27e/extractor/0.log" Jun 14 15:45:06.818874 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:06.818844 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-sxld2" Jun 14 15:45:08.199389 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.199354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690835-btqbr_5e3d14e7-bd0a-4389-bd92-e423da0a1f8f/cleanup/0.log" Jun 14 15:45:08.231368 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.231334 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690850-l5ccl_0eec4646-4932-4b4d-94f1-6c588aaee4b6/cleanup/0.log" Jun 14 15:45:08.258220 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.258190 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690865-p9pk2_5f4df44b-36bb-4a64-9c36-f5d8ce919a2d/cleanup/0.log" Jun 14 15:45:08.528290 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.528244 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-lvxz6_9d99b326-8f71-4258-80d9-d54f96040a9d/manager/0.log" Jun 14 15:45:08.553688 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.553663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-lvxz6_9d99b326-8f71-4258-80d9-d54f96040a9d/copy-manifests/0.log" Jun 14 15:45:08.698676 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:08.698647 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s4b7z_411419fb-e9d5-4af1-a7ed-ab80da723a6b/postgres/0.log" Jun 14 15:45:10.503231 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:10.503200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d55879689-b2bfk_2155d5d8-3ae5-49c3-8dd2-98998e0e1047/manager/0.log" Jun 14 15:45:13.505504 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:13.505472 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-w496v_91539380-3fe4-4b55-8124-a1d37dc9ee9d/kube-auth-proxy/0.log" Jun 14 15:45:15.147256 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:15.147216 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-w496v_91539380-3fe4-4b55-8124-a1d37dc9ee9d/kube-auth-proxy/0.log" Jun 14 15:45:16.429783 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:16.429709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-k8pbq_31733dd6-33fb-44bd-8662-3359ce9e7414/kube-storage-version-migrator-operator/1.log" Jun 14 15:45:16.431775 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:16.431711 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-k8pbq_31733dd6-33fb-44bd-8662-3359ce9e7414/kube-storage-version-migrator-operator/0.log" Jun 14 15:45:17.424888 ip-10-0-139-109 kubenswrapper[2577]: I0614 15:45:17.424862 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-w496v_91539380-3fe4-4b55-8124-a1d37dc9ee9d/kube-auth-proxy/0.log"